Big Data Engineer

  • location: Huntington Beach, CA
  • type: Permanent
  • salary: $110,000 - $120,000 per year

job description

Big Data Engineer

job summary:
Responsibilities

- Architect, design, develop, implement, configure and document current and future Hadoop infrastructure

- Perform software installation and configuration, database backup and recovery, storage management, performance tuning, database connectivity and security

- Implement and support various components of the Hadoop ecosystem

- Monitor Hadoop cluster connectivity and performance.

- HDFS support and maintenance.

- Setting up new Hadoop users.

- Responsible for the new and existing administration of Hadoop infrastructure.

- Support data modelling, design and implementation,

- Work closely with infrastructure, network, database, business intelligence and application teams to ensure business applications are readily available and performing within agreed upon service levels

- Develop tools for automated build test deployment and management of the platform

- Continuously improve integration and delivery systems

Qualifications

- Bachelor's degree in Computer Science, Information Systems, Information Technology, Management Information Systems, or equivalent experience is preferred

- 3+ years designing, developing and implementing solutions in Hadoop environments

- 3+ years supporting technologies in the Hadoop ecosystem

- Expertise with HDFS, YARN, MapReduce, Hive, Pig, Spark

- Proficiency with Hadoop technologies such as Nifi, HDFS, HBase, Flume and Sqoop

- Ability to write reliable, manageable and highly efficient code using Hadoop tools

- Proficiency with SQL scripting

- Experience in backend programming, particularly Java, JavaScript, Python, R, Scala

- Working knowledge of Linux/Unix, distributed computing, networks and network security

- Strong problem solving and analytical skills

- Effective oral and written communication skills for both technical and non-technical audiences

- Excellent systems and data analysis skills

- Ability to prioritize and manage competing projects

 
location: Huntington Beach, California
job type: Permanent
salary: $110,000 - 120,000 per year
work hours: 8am to 4pm
education: Bachelors
 
responsibilities:
- Architect, design, develop, implement, configure and document current and future Hadoop infrastructure

- Perform software installation and configuration, database backup and recovery, storage management, performance tuning, database connectivity and security

- Implement and support various components of the Hadoop ecosystem

- Monitor Hadoop cluster connectivity and performance.

- HDFS support and maintenance.

- Setting up new Hadoop users.

- Responsible for the new and existing administration of Hadoop infrastructure.

- Support data modelling, design and implementation,

- Work closely with infrastructure, network, database, business intelligence and application teams to ensure business applications are readily available and performing within agreed upon service levels

- Develop tools for automated build test deployment and management of the platform

- Continuously improve integration and delivery systems

 
qualifications:
  • Experience level: Experienced
  • Minimum 3 years of experience
  • Education: Bachelors
 
skills:
  • Hadoop (3 years of experience is required)
  • SSIS (3 years of experience is required)
  • BIGDATA

Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

Qualified applicants in San Francisco with criminal histories will be considered for employment in accordance with the San Francisco Fair Chance Ordinance.

We will consider for employment all qualified Applicants, including those with criminal histories, in a manner consistent with the requirements of applicable state and local laws, including the City of Los Angeles' Fair Chance Initiative for Hiring Ordinance.

get jobs in your inbox.

sign up
{{returnMsg}}

related jobs

    Data Engineer - Splunk

  • location: Irvine, CA
  • job type: Contract
  • salary: $65 - $75 per hour
  • date posted: 8/4/2020

    Mechanical Engineer

  • location: Cerritos, CA
  • job type: Permanent
  • salary: $85,000 - $110,000 per year
  • date posted: 7/29/2020

    Mechanical Engineer

  • location: Redondo Beach, CA
  • job type: Contract
  • salary: $65 - $68 per hour
  • date posted: 1/22/2020