Data Engineer

The Senior Data Engineer plays a pivotal role in designing, building, and maintaining scalable data infrastructure to support both analytical and operational needs across the organization. Leveraging deep expertise in cloud data platforms, ETL development, and programming, this role will focus on optimizing data pipelines, improving performance, and ensuring the integrity and reliability of our data ecosystem. You will collaborate closely with data scientists, analysts, and business stakeholders to drive impactful insights through reliable and accessible data.

Key Responsibilities

• Design, develop, and maintain high-quality, scalable, and efficient data pipelines and ETL workflows.
• Continuously optimize data processing for performance, latency, and scalability using best-in-class practices.
• Adapt ETL solutions in response to changes in internal and external data sources, including third-party APIs and event streams.
• Monitor and enhance data quality, implementing automated checks and validation mechanisms to ensure consistent and reliable datasets.
• Integrate data across diverse systems to support unified data access and reporting.
• Translate existing data processing logic from R to Python, ensuring consistency and performance.
• Automate data-related tasks using tools such as SQL, Python, Rivery, Fivetran, and Airflow.
• Build and manage data models, testing suites, documentation, and version control using dbt (Data Build Tool).

Required Qualifications

• Bachelor's degree or higher in Computer Science, Engineering, Mathematics, Statistics, or a related field.
• 5–8 years of hands-on experience in data engineering, software development, or a related discipline.
• Strong experience with cloud platforms such as AWS, Azure, or Google Cloud Platform, particularly with data services like Amazon Redshift or Google BigQuery.
• Proficient in Python and SQL (knowledge of R is a plus), with a solid foundation in building and maintaining complex data pipelines and ETL solutions.
• Proficient in Airflow and dbt (Data Build Tool)
• Strong analytical and problem-solving abilities, capable of troubleshooting complex data issues and delivering robust, scalable solutions.