Data Engineer

  • location: San Jose, CA (remote)
  • type: Contract
  • salary: $50 - $55 per hour

job description

Data Engineer

job summary:
Data Engineer top skills needed:

  • Python Programming Coding Expertise
  • Pyspark
  • Data Lake, Glue
What you'll do

Software is a team sport. The best software is built by the highest functioning teams peopled with supremely skilled fiercely collaborative engineers. You will throw your lot in with fellow engineers to build high quality, high scale & customer delighting SaaS products.

We are looking for engineers with a growth mindset, eager to do their best work and build the best products possible. Simply put, you will deliver excellent software on a results-driven, high-trust team.

Primary Responsibilities include:

? Build data pipelines in a scalable cloud environment

? Partner closely with product management to identify, scope, estimate work

for team

? Lead teams in the delivery of data pipelines

? Mentor junior engineers to produce their best work

? Take ownership for large portions of the platform, across different

engineering teams, and help us design, deliver and maintain that code going

forward

Required Skills/Experience

? 8+ years designing, developing and deploying data pipelines

? 5+ years of shipping cloud native software in AWS

? Experience taking difficult problems and translating them into solutions

? Experience in creating and maintaining large scale distributed cloud native

technology stacks that achieve over 99.98% uptime

? strong ability to collaborate, finding win-win solutions within Engineering

and partnering with Product

? strong communication skills and ability to engage, interface and influence

partners

? Experience with Spark, Presto, AirFlow,Kinesis , Kafka streams

? Experience with AWS Services, Linux, Docker, CloudFormation, Terraform,

DynamoDB, Aurora

? Experience with Programming languages such as GoLang, Python

? Familiarity with AI/ML solutions

 
location: SAN JOSE, California
job type: Contract
salary: $50 - 55 per hour
work hours: 8am to 4pm
education: Bachelors
 
responsibilities:
Primary Responsibilities include:

? Build data pipelines in a scalable cloud environment

? Partner closely with product management to identify, scope, estimate work for team

? Lead teams in the delivery of data pipelines

? Mentor junior engineers to produce their best work

? Take ownership for large portions of the platform, across different engineering teams, and help us design, deliver and maintain that code going forward

 
qualifications:
  • Experience level: Experienced
  • Minimum 3 years of experience
  • Education: Bachelors
 
skills:
  • Golang (2 years of experience is preferred)
  • AWS (2 years of experience is required)
  • Python (2 years of experience is required)
  • Terraform (2 years of experience is preferred)
  • CI/CD
  • pyspark (2 years of experience is required)
  • AWS Glue (1 year of experience is required)

Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

Qualified applicants in San Francisco with criminal histories will be considered for employment in accordance with the San Francisco Fair Chance Ordinance.

We will consider for employment all qualified Applicants, including those with criminal histories, in a manner consistent with the requirements of applicable state and local laws, including the City of Los Angeles' Fair Chance Initiative for Hiring Ordinance.

get jobs in your inbox.

sign up
{{returnMsg}}

related jobs


    Data Scientist lead

  • location: San Jose, CA (remote)
  • job type: Permanent
  • salary: $150,000 - $170,000 per year
  • date posted: 7/19/2021