Data Operations Engineer

  • location: San Francisco, CA
  • type: Contract
  • salary: $60 - $65 per hour

job description

Data Operations Engineer

job summary:
Data Operations Engineer

Need someone strong in working with Matillion and building frameworks in which ETLs are built on using paralell processing pipelines. Python programming experience for automation.

  • 6+ years in Data Engineering or similar roles working with backend systems and large, disparate, and complex datasets
  • Solid understanding of large-scale data warehousing, ETL best practices, RDBMS, API integration
  • 2+ years practical development experience with Snowflake and Matillion
  • 2+ years practical experience using Git to manage source code
  • 5+ years practical development and administration experience with AWS infrastructure (EC2, EBS, Lambda)
  • Demonstrated track record of proactively identifying, summarizing, and remediating gaps in data processing efficiency, with an emphasis on: automation, modularization, component reuse, exception handling, and processing parallelization
  • strong communication skills and experience working with technical and non-technical stakeholders to solve problems
  • Ability to work independently with little supervision to deliver on-time, clean, and well-tested code on a regular basis
  • Expert Python skills, broad experience in writing, debugging and testing code
  • Other scripting expertise, such as Powershell, is a huge plus
 
location: San Francisco, California
job type: Contract
salary: $60 - 65 per hour
work hours: 8am to 4pm
education: Bachelors
 
responsibilities:
Data Operations Engineer

  • 6+ years in Data Engineering or similar roles working with backend systems and large, disparate, and complex datasets
  • Solid understanding of large-scale data warehousing, ETL best practices, RDBMS, API integration
  • 2+ years practical development experience with Snowflake and Matillion
  • 2+ years practical experience using Git to manage source code
  • 5+ years practical development and administration experience with AWS infrastructure (EC2, EBS, Lambda)
  • Demonstrated track record of proactively identifying, summarizing, and remediating gaps in data processing efficiency, with an emphasis on: automation, modularization, component reuse, exception handling, and processing parallelization
  • strong communication skills and experience working with technical and non-technical stakeholders to solve problems
  • Ability to work independently with little supervision to deliver on-time, clean, and well-tested code on a regular basis
  • Expert Python skills, broad experience in writing, debugging and testing code
  • Other scripting expertise, such as Powershell, is a huge plus
 
qualifications:
  • Experience level: Experienced
  • Minimum 5 years of experience
  • Education: Bachelors (required)
 
skills:
  • snowflake (2 years of experience is required)
  • matillion (2 years of experience is required)
  • EC2 (2 years of experience is required)
  • Git (2 years of experience is required)
  • Python (4 years of experience is required)

Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

Qualified applicants in San Francisco with criminal histories will be considered for employment in accordance with the San Francisco Fair Chance Ordinance.

We will consider for employment all qualified Applicants, including those with criminal histories, in a manner consistent with the requirements of applicable state and local laws, including the City of Los Angeles' Fair Chance Initiative for Hiring Ordinance.

get jobs in your inbox.

sign up
{{returnMsg}}

related jobs

    Senior Data Engineer

  • location: San Bruno, CA
  • job type: Contract
  • salary: $45 - $69 per hour
  • date posted: 10/21/2020

    Data Analyst

  • location: San Francisco, CA
  • job type: Contract
  • salary: $55 - $60 per hour
  • date posted: 10/1/2020

    Data Manager

  • location: San Francisco, CA
  • job type: Contract
  • salary: $50 - $70 per hour
  • date posted: 10/9/2020