Big Data Engineer
About Us:
At micro1, we’re all about connecting skilled remote professionals with some of the best companies in Silicon Valley. Our mission is to offer a stable, competitive income, along with access to top industry opportunities—all in a flexible work setting with a range of great benefits. We’re here to help you grow in your career. We're proud to work with trusted partners such as Deel, Immutable, O’Gara, and LegalSoft.
What We Offer:
- Work from anywhere,
- Healthcare reimbursement,
- Wi-Fi reimbursement,
- Unlimited learning, and more!
Job Summary:
Join our dynamic team at micro1 as a Big Data Engineer, where you'll be at the forefront of handling and processing large-scale data. As part of our mission, you'll enjoy a flexible work setting that empowers you to grow in your career while being a key player in designing and managing data pipelines.
Key Responsibilities:
- Design and implement robust data pipelines to facilitate seamless data flow.
- Work with industry-leading big data frameworks such as Hadoop and Spark.
- Ensure data integrity and security across all platforms.
- Collaborate with cross-functional teams to understand data requirements.
- Optimize data processing and storage for efficiency and performance.
- Maintain up-to-date documentation of data processes and systems.
- Continuously explore new technologies and methods to improve data management.
Required Skills and Qualifications:
- Proven experience with Hadoop and Spark frameworks.
- Strong knowledge of data warehousing principles and practices.
- Excellent written and verbal communication skills.
- Ability to work independently in a remote environment.
- Detail-oriented with a commitment to data integrity and quality.
Preferred Qualifications:
- Experience with cloud-based data solutions.
- Background in collaborating with Silicon Valley tech companies.
