Hadoop Developer

  • location: Wilmington, DE
  • type: Contract
  • salary: $55 - $60 per hour

job description

One of our Wilmington, DE clients has an immediate need for an Hadoop Developer.

Responsibilities:

  • Develop highly scalable and extensible Big Data platform, which enables collection, storage, modeling, and analysis of massive data sets from numerous channels loading from disparate data sets ETL coding using Hive and Spark.
  • Translate complex functional and technical requirements into detailed design.
  • Maintain security, data privacy and data quality.
  • Continuously evaluate new technologies, innovate and deliver solution for business critical applications.
  • Test prototypes and oversee handover to operational teams. Propose best practices/standards.

Mandatory experience:

  • Working with Hadoop Writing HQL and Spark Code Loading data into Hadoop Working with job scheduling tools

Preferred Experience:

  • Reading and writing data to Kafka Processing real time data with Spark Streaming or other technology.
  • Writing high-performance, reliable and maintainable code.
  • Ability to write Spark jobs.
  • Good knowledge of database structures, theories, principles, and practices.
  • Proficiency in writing SQL including HiveQL.
  • Knowledge of workflow schedulers Analytical and problem solving skills, applied to Big Data domain Proven understanding of Hadoop SQL base tools such as Hive & Impala.
  • Good aptitude in multi-threading, concurrency and distributed processing concepts.

Preferred Skills:

  • Familiarity with data loading tools such Flume and Sqoop.
  • Familiar with real time streaming tools such as Kafka and Spark Streaming.
  • Understanding of file formats such as Avro and Parquet including serialization/deserialization
  • Understanding NoSQL technologies such as HBase, MongoDB and Cassandra. Solid understanding of Data Warehousing concepts.

get jobs in your inbox.

sign up
{{returnMsg}}

related jobs

    ETL Developer

  • location: Wilmington, DE
  • job type: Contract
  • salary: $50 - $55 per hour
  • date posted: 5/21/2018

    Senior Developer

  • location: Glen Mills, PA
  • job type: Contract
  • salary: $55 - $75 per hour
  • date posted: 5/23/2018

    .Net Developer

  • location: West Chester, PA
  • job type: Temp to Perm
  • date posted: 5/23/2018