Senior Data Engineer

About the Role

Rocket Lawyer is seeking an experienced, passionate data engineer for Rocket Data Platform. In this role, you will build a highly reliable, trustworthy data lakehouse that is leveraged across the organization to derive insights and make real-time decisions. You will be bringing your skills to drive new data projects, build reliable data pipelines, set up strong monitoring and alerting systems, and build data solutions to support a diverse set of use cases.

We value a fun, collaborative, team-oriented work environment, where we celebrate our accomplishments. 

Responsibilities

• Design and develop data pipelines using tools like Apache Airflow or by leveraging Snowflake's external tables functionality.
• Translate HiveQL queries to Snowflake SQL, ensuring compatibility and efficient data processing.
• Utilize dbt to model and transform data within Snowflake, adhering to best practices for data governance and maintainability.
• Configure and manage data pipelines in GCP to orchestrate data movement and processing tasks.
• Collaborate with data analysts and stakeholders to understand data requirements and ensure a successful migration outcome.
• Monitor and optimize data pipelines for performance and scalability.
• Develop and implement automated testing procedures to validate data quality and integrity after migration.
• Document the migration process and provide ongoing support for the migrated data warehouse on Snowflake.

Requirements

• Minimum 5+ years of experience as a Data Engineer with a proven track record of successful data warehouse/data lake implementation and management.
• Deep understanding of leveraging Snowflake to build highly performant and resilient datawarehouse.
• Strong expertise in HiveQL, SQL, and experience with data warehousing/lake house concepts (dimensional modeling, data quality, etc.).
• Strong programming knowledge in python.
• Experience with Apache Spark for large-scale data processing (a plus).
• Proficiency in dbt for data modeling and transformation in Snowflake preferred.
• Experience working with Google Cloud Platform (GCP) and its data storage services (GCS, BigQuery - a plus).
• Excellent written and verbal communication skills with the ability to collaborate effectively with cross-functional teams.
• Strong problem-solving skills and a passion for building efficient and scalable data solutions.
• Snowflake certification preferred.

Preferred Qualifications:

• Strong understanding of data architectures and patterns.
• Experience in DataOps implementation and support
• Experience in MLOps implementation and support.
• Experience in building and supporting AI/ML platform.