The Data Engineer is responsible for designing, building, and maintaining scalable data pipelines and systems that deliver trusted data for analysis and product use cases. This role partners with cross-functional teams to understand data needs and implement solutions that support both near-term and long-term objectives. This role requires the ability to contribute to technical design, ensure data quality, and operate with increasing independent and accountability.
location: Telecommute
job type: Contract
salary: $55.80 - 64.33 per hour
work hours: 9am to 5pm
education: Bachelors
responsibilities:
JOB DESCRIPTION Profile Summary:
The Data Engineer is responsible for designing, building, and maintaining scalable data pipelines and systems that deliver trusted data for analysis and product use cases. This role partners with cross-functional teams to understand data needs and implement solutions that support both near-term and long-term objectives. This role requires the ability to contribute to technical design, ensure data quality, and operate with increasing independent and accountability.
Profile Description:
- Develop and maintain batch and streaming data pipelines using modern tools and frameworks. Design transformations, optimize performance, and ensure reliable data delivery.
- Design and implement scalable and maintainable data models and storage solutions that align with business needs and support efficient querying, analysis, and data integration efforts.
- Engage in agile best practices, help refine stories, identify dependencies, and proactively raise risks or concerns to ensure work is completed on time or escalated when needed.
- Implement and enforce data quality controls, validation, and compliance standards across pipelines.
- Support the deployment, scheduling, and monitoring of data pipelines and workflows to ensure consistent, reliable execution.
- Maintain comprehensive documentation and advocate for coding standards, best practices, and reusable components.
- Collaborate regularly with cross-functional teams to clarify data requirements, document assumptions, and deliver high-quality solutions. Communicate clearly during stand-ups, design discussion, and retrospectives. Actively contribute to team code reviews and sharing learnings with peers.
- 2-5 years of experience in data engineering, data modeling, and ETL pipelines
- Proficient in SQL and Python for creating, improving, and fixing data pipelines
- Experience with cloud and data platforms, especially Azure and Databricks (Delta Live Tables and Unity Catalog)
- Strong understanding of tools like SnapLogic, Azure Data Factory, and Jenkins for data integration and orchestration
- Practical experience with Terraform for infrastructure as code and managing deployment pipelines
- Experience integrating with APIs.
- Knowledge of data quality and monitoring tools, particularly Soda or similar
- Proficient in version control and CI/CD workflows, using tools like GitHub
- Solid understanding of data modeling principles (e.g., dimensional modeling, normalization)
- Comfortable working in agile teams, with a proactive approach to planning, organizing tasks, and collaborating
qualifications:
2-5 years of experience in data engineering, data modeling, and ETL pipelines
Proficient in SQL and Python for creating, improving, and fixing data pipelines
Experience with cloud and data platforms, especially Azure and Databricks (Delta Live Tables and Unity Catalog)
Strong understanding of tools like SnapLogic, Azure Data Factory, and Jenkins for data integration and orchestration
Practical experience with Terraform for infrastructure as code and managing deployment pipelines
Experience integrating with APIs.
Knowledge of data quality and monitoring tools, particularly Soda or similar
Proficient in version control and CI/CD workflows, using tools like GitHub
Solid understanding of data modeling principles (e.g., dimensional modeling, normalization)
Comfortable working in agile teams, with a proactive approach to planning, organizing tasks, and collaborating
skills:
APIs,Azure Data Factory,code reviews,CI/CD workflows,data delivery,data integration,data platforms,scalable data pipelines,data pipelines,streaming data,Databricks,deployment pipelines,dimensional modeling,ETL pipelines,GitHub,SnapLogic,data engineering,Jenkins,Azure,monitoring tools,Python,version control,Proficient in SQL,integrating,Terraform for infrastructure as code,organizing,proactively,proactive approach,collaborating,business needs,data models,data modeling,data quality,technical design,comprehensive documentation,compliance standards,normalization,Communicate clearly,use cases,scheduling,storage solutions,workflows
Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.
At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact HRsupport@randstadusa.com.
Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including: medical, prescription, dental, vision, AD&D, and life insurance offerings, short-term disability, and a 401K plan (all benefits are based on eligibility).
This posting is open for thirty (30) days.
It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.
