As a member of the Data Engineering team you will be required to leverage strong data engineering experience with cutting edge technologies in the NoSQL, Hadoop ecosystem and data lake/warehouse spaces to support and enable a true data driven company. The ideal candidate will have a track record of developing data pipelines to extract, transform and aggregate data that can scale to petabytes, elastically, with low latency and high availability.

Qualifications

  • A background in Computer Science, Engineering, Mathematics or appropriate industry experience
  • Experience building complex data pipelines for data integration from enterprise wide applications/systems into centralised big data lakes/warehouses
  • Advanced experience and understanding of distributed database technologies/concepts
  • Experience integrating with Big Data platforms including Spark and Kafka
  • Strong analytical competencies with the ability to turn requests from Business Intelligence and Data Analyst personnel into efficient and scalable data transformations
  • A proficient Python programmer
  • Experience processing data at scale with a concrete understanding of the tradeoffs and challenges of a variety of implementations
  • Experience building and enforcing strong data quality guarantees and anomaly detection into data pipelines

Nice To Haves

  • Experience with AWS internals and their suite of product offerings
  • Knowledge of database internals, transactions, clustering, sharding, and replication
  • Knowledge of optimised data storage and serialisation formats
  • Fundamental data science knowledge and experience

What we expect from you

  • You are a data visionary that believes in the power and potential of being data driven
  • Be willing to share your expertise and mentor less experienced engineers
  • Able to work quickly and independently within a fast pace agile team
  • Exhibit strong ownership of all aspects of assigned projects, tasks, issues, and code
  • Possess a natural tendency to analyze and optimize platform scalability and efficiency
  • Continually seek to improve your skills and keep abreast of industry trends
  • Able to evaluate and experiment with emerging technological trends and apply them to new and existing projects as well as certify their usage for wider adoption throughout MongoDB
  • Can adapt to new, different or changing business requirements, able to distill complex problems into concrete technical requirements and are comfortable identifying alternatives and making timely decisions