Sr Data Engineer

  • location: Hillsboro, OR
  • type: Contract
  • salary: $65 - $70 per hour

job description

Sr Data Engineer

job summary:
Randstad Technologies is seeking a skilled Sr. Data Engineer for a contract role in Hillsboro Oregon. If you are ready to join a leader in the Retail and Technology space, please apply and Randstad will be more than happy to assist in helping you land your next role. We look forward to speaking with you!

 
location: Hillsboro, Oregon
job type: Contract
salary: $65 - 70 per hour
work hours: 8am to 4pm
education: Bachelors
 
responsibilities:
We're looking to expand our Data Engineering team to keep pace. As a Senior Data Engineer, you will work with a variety of talented teammates and be a driving force for building first-class solutions for the Technology and its business partners, working on development projects related to supply chain, commerce, consumer behavior and web analytics among others.

Role responsibilities:

  • Design and implement data products and features in collaboration with product owners, data analysts, and business partners using Agile / Scrum methodology
  • Contribute to overall architecture, frameworks and patterns for processing and storing large data volumes
  • Translate product backlog items into engineering designs and logical units of work
  • Profile and analyze data for the purpose of designing scalable solutions
  • Define and apply appropriate data acquisition and consumption strategies for given technical scenarios
  • Design and implement distributed data processing pipelines using tools and languages prevalent in the big data ecosystem
  • Build utilities, user defined functions, libraries, and frameworks to better enable data flow patterns
  • Implement complex automated routines using workflow orchestration tools
  • Work with architecture, engineering leads and other teams to ensure quality solutions are implemented, and engineering best practices are defined and adhered to
  • Anticipate, identify and solve issues concerning data management to improve data quality
  • Build and incorporate automated unit tests and participate in integration testing efforts
  • Utilize and advance continuous integration and deployment frameworks
  • Troubleshoot data issues and perform root cause analysis
  • Work across teams to resolve operational & performance issues
The following qualifications and technical skills will position you well for this role:

  • MS/BS in Computer Science, or related technical discipline
  • 5+ years of experience in large-scale software development, 3+ years of big data experience
  • strong programming experience, Python preferred
  • Extensive experience working with Hadoop and related processing frameworks such as Spark, Hive, etc.
  • Experience with messaging/streaming/complex event processing tooling and frameworks with an emphasis on Spark Streaming or Structured Streaming and Apache Nifi
  • Good understanding of file formats including JSON, Parquet, Avro, and others
  • Familiarity with data warehousing, dimensional modeling, and ETL development
  • Experience with RDBMS systems, SQL and SQL Analytical functions
  • Experience with workflow orchestration tools like Apache Airflow
  • Familiarity with data warehousing, dimensional modeling, and ETL development
  • Experience with performance and scalability tuning
The following skills and experience are also relevant to our overall environment, and nice to have:

  • Experience with Scala or Java
  • Experience working in a public cloud environment, particularly AWS, and with services like EMR, S3, Lambda, ElastiCache, DynamoDB, SNS, SQS, etc
  • Familiarity with cloud warehouse tools like Snowflake
  • Experience building RESTful API's to enable data consumption
  • Familiarity with build tools such as Terraform or CloudFormation and automation tools such as Jenkins or Circle CI
  • Familiarity with practices like Continuous Development, Continuous Integration and Automated Testing
  • Experience in Agile/Scrum application development
These are the characteristics that we strive for in our own work. We would love to hear from candidates who embody the same:

  • Desire to work collaboratively with your teammates to come up with the best solution to a problem
  • Demonstrated experience and ability to deliver results on multiple projects in a fast-paced, agile environment
  • Excellent problem-solving and interpersonal communication skills
  • strong desire to learn and share knowledge with others
 
qualifications:
  • Experience level: Experienced
  • Education: Bachelors
 
skills:
  • data engineering
  • Nifi
  • Apache

Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

get jobs in your inbox.

sign up
{{returnMsg}}

related jobs

    Sr. Data Engineer

  • location: Hillsboro, OR
  • job type: Contract
  • salary: $65 - $70 per hour
  • date posted: 10/7/2020

    Sr. Data Engineer

  • location: Beaverton, OR
  • job type: Contract
  • salary: $60 - $65 per hour
  • date posted: 10/5/2020

    Sr. Data Engineer

  • location: Beaverton, OR
  • job type: Contract
  • salary: $60 - $65 per hour
  • date posted: 10/5/2020