Senior Data Engineer

  • 100x Group
  • Singapore
  • May 17, 2021
Full time Data Engineering - Backend

Job Description

BitMEX is the leader in the Bitcoin/USD market and is rapidly expanding. As one of the fastest-growing companies in the Cryptocurrency and Fintech space, we provide a unique, trading-focused experience to digital currency markets.

As a data engineering lead, you’ll shape the way we approach data at BitMEX by using your engineering, analytical and communication skills to work with teams across the business. With experience working with designing, architecting, and developing data pipelines, you will collaborate with teams building up our data platforms from scratch.

Responsibilities: 

  • Lead design and implementation of appropriate data architectures, infrastructure, data ingestion pipelines and enablement tools, processes, and controls to help the Data Engineering team grow at scale
  • Build scalable and reliable data pipeline that collects, transforms, loads and curates data from internal systems and external sources, provide consumable data for various analysis
  • Work with engineering counterparts to shape the roadmap for data needs
  • Implement risk monitoring systems to improve tracking and mitigation of several risks including money laundering, financial fraud and margin exposure
  • Work closely with data scientists and collaborate with back-end, front-end engineers to build products for gathering timely insights about customer behavior, etc
  • Create monitoring systems to track of the quality of data and the health of our systems

Qualifications: 

  • 5+ years of experience owning and building data pipelines
  • Demonstrated ability to build complex, scalable systems with high quality
  • Extensive knowledge of data engineering tools, technologies and approaches
  • Fluent in one or more of Python, Java and bash
  • Experience with specific AWS technologies (such as S3, Redshift, and Kinesis)
  • Experience with multiple data technologies and concepts such as Airflow, SQL, Hadoop, MapReduce, Spark, NATS, Redis, Zookeeper
  • Experience in Kubernetes, Docker
  • Experience in Data Encryption/Decryption
  • Financial services experience is strongly preferred