Data Engineer

  • Kraken
  • Remote
  • Mar 25, 2021
Full time Data Engineering - Data

Job Description

About the Role
The data engineering team is responsible for designing and implementing scalable solutions that allow the company to make data-driven decisions fast and accurately on several terabytes of data. The data engineering team has just launched the company’s new data warehouse, and you will be responsible for creating various pipelines to move vast amounts of data into the new warehouse.

Responsibilities

    • Build scalable and reliable data pipeline that collects, transforms, loads and curates data from internal systems
    • Augment data platform with data pipelines from select external systems
    • Ensure high data quality for pipelines you build and make them auditable
    • Drive data systems to be as near real-time as possible
    • Support design and deployment of distributed data store that will be central source of truth across the organization
    • Build data connections to company's internal IT systems
    • Develop, customize, configure self service tools that help our data consumers to extract and analyze data from our massive internal data store
    • Evaluate new technologies and build prototypes for continuous improvements in data engineering

Requirements

      • 5+ years of work experience in relevant field (Data Engineer, DW Engineer, Software Engineer, etc)
      • Experience with data warehouse technologies and relevant data modeling best practices (Spark, Presto, Druid, etc)
      • Experience building data pipelines/ETL and familiarity with design principles
      • Excellent SQL skills
      • Proficiency in a major programming language (e.g. Java, C++, etc) and/or a scripting language (Javascript, Python, etc)
      • Experience with business requirements gathering for data sourcing