Hadoop developer

  • location: Chandler, AZ
  • type: Contract
  • salary: $62 - $66.99 per hour

job description

Hadoop developer

job summary:
Design and build high performing and scalable data pipeline platform using Hadoop, Apache Spark, MongoDB and object storage architecture.

Partner with Enterprise data teams such as Data Management & Insights and other technology teams on data delivery services and deliverables.

Work with business analysts, development teams and project managers for requirements and business rules.

Collaborate with source system and approved provisioning point (APP) teams, Architects, Data Analysts and Modelers to build scalable and performant data solutions.

Work with Infrastructure Engineers and System Administrators as appropriate in designing and optimizing the big-data infrastructure.

Support ongoing data management efforts for Development, QA and Production environments

Utilizes a thorough understanding of available technology, tools, and existing designs.

Leverage knowledge of industry trends to build best in class technology to provide competitive advantage.

Acts as expert technical resource to programming staff in the program development, testing, and implementation process

- Software engineering experience

- ETL (Extract, Transform, Load) Programming experience

- Agile experience

- Hadoop experience

- Java or Python experience

- Design and development experience with columnar databases using Parquet or ORC file formats on Hadoop

- Apache Spark design and development experience using Scala, Java, Python or Data Frames with Resilient - Distributed Datasets (RDDs)

- Nice to hve - Experience integrating with RESTful API

- Nice to have - operational risk, conduct risk or compliance domain experience

- Nice to have - Experience with containers: Dockers, Kubernetes

 
location: Chandler, Arizona
job type: Contract
salary: $62.00 - 66.99 per hour
work hours: 8am to 4pm
education: Bachelors
 
responsibilities:
Design and build high performing and scalable data pipeline platform using Hadoop, Apache Spark, MongoDB and object storage architecture.

Partner with Enterprise data teams such as Data Management & Insights and other technology teams on data delivery services and deliverables.

Work with business analysts, development teams and project managers for requirements and business rules.

Collaborate with source system and approved provisioning point (APP) teams, Architects, Data Analysts and Modelers to build scalable and performant data solutions.

Work with Infrastructure Engineers and System Administrators as appropriate in designing and optimizing the big-data infrastructure.

Support ongoing data management efforts for Development, QA and Production environments

Utilizes a thorough understanding of available technology, tools, and existing designs.

Leverage knowledge of industry trends to build best in class technology to provide competitive advantage.

Acts as expert technical resource to programming staff in the program development, testing, and implementation process

- Software engineering experience

- ETL (Extract, Transform, Load) Programming experience

- Agile experience

- Hadoop experience

- Java or Python experience

- Design and development experience with columnar databases using Parquet or ORC file formats on Hadoop

- Apache Spark design and development experience using Scala, Java, Python or Data Frames with Resilient - Distributed Datasets (RDDs)

- Nice to hve - Experience integrating with RESTful API

- Nice to have - operational risk, conduct risk or compliance domain experience

- Nice to have - Experience with containers: Dockers, Kubernetes

 
qualifications:
  • Experience level: Experienced
  • Minimum 5 years of experience
  • Education: Bachelors
 
skills:
  • Hadoop
  • scala
  • Python
  • Java

Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

get jobs in your inbox.

sign up
{{returnMsg}}

related jobs

    Talend ETL Developer

  • location: Chandler, AZ
  • job type: Contract
  • salary: $63.50 - $68.50 per hour
  • date posted: 9/17/2021


    Senior SQL Developer

  • location: Scottsdale, AZ
  • job type: Contract
  • salary: $45 - $65 per hour
  • date posted: 10/12/2021