Big Data Cloud Engineer

  • location: Philadelphia, PA
  • type: Temp to Perm
  • salary: $50 - $70 per hour
easy apply

job description

Big Data Cloud Engineer

job summary:
We are seeking a highly motivated, hands-on and talented Big Data Cloud Engineer. As a Big Data Cloud Engineer you will be responsible for building repeatable Data Lake solutions.

 
location: Philadelphia, Pennsylvania
job type: Contract
salary: $50 - 70 per hour
work hours: 9am to 5pm
education: Bachelors
 
responsibilities:
  • Develop and deploy fully automated and scalable Big Data Solutions including ingesting, transforming and persisting the data from various data sources including but not limited to SQL, NoSQL, NAS etc
  • Develop Hadoop, MapReduce and/or Amazon EMR workloads for processing large volumes of data
  • Develop data pipelines for orchestrating data movements between different stages of data lifecyle using Airflow, Luigi and AWS Data Pipeline
  • Implement data cataloging, metadata, data quality checks, Master Data Management (MDM) in data lake architectures
  • Develop Business Intelligence and visualization dashboards using Tableau, YellowFin, Birst, Looker or QuickSight
 
qualifications:
  • 5+ years of experience with at least 2 years in developing and solving Big Data solutions/problems
  • BS in Computer Science or equivalent field of study
  • Hands on experience with SQL and NoSQL
  • Hands on experience in MapReduce, Spark, ETL
  • Experience with as many tools as possible in Hadoop eco system and platforms (Apache, Hadoop, Falcon, Atlas, Tez, Sqoop, Flume, Kafka, Pig, Hive, HBase, Accumulo, Storm, Solr, Spark, Ranger, Knox, Ambari, ZooKeeper, Oozie, Phoenix, NiFi, Nifi Registry, HAWQ, Zeppelin, Slider, Mahout, MapReduce, HDFS, YARN
  • Strong AWS experience
  • Hands on experience working with Relational Databases (MSSQL, MySQL, PostgreSQL)
  • Experience working in Agile environments and projects
 
skills:
  • 5+ years of experience with at least 2 years in developing and solving Big Data solutions/problems
  • BS in Computer Science or equivalent field of study
  • Hands on experience with SQL and NoSQL
  • Hands on experience in MapReduce, Spark, ETL
  • Experience with as many tools as possible in Hadoop eco system and platforms (Apache, Hadoop, Falcon, Atlas, Tez, Sqoop, Flume, Kafka, Pig, Hive, HBase, Accumulo, Storm, Solr, Spark, Ranger, Knox, Ambari, ZooKeeper, Oozie, Phoenix, NiFi, Nifi Registry, HAWQ, Zeppelin, Slider, Mahout, MapReduce, HDFS, YARN
  • Strong AWS experience
  • Hands on experience working with Relational Databases (MSSQL, MySQL, PostgreSQL)
  • Experience working in Agile environments and projects

Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

easy apply

get jobs in your inbox.

sign up
{{returnMsg}}

related jobs

    Senior Software Engineer

  • location: Conshohocken, PA
  • job type: Permanent
  • salary: $90,000 - $120,000 per year
  • date posted: 8/28/2019


    AWS Full Stack Engineer

  • location: Malvern, PA
  • job type: Contract
  • salary: $45 - $50 per hour
  • date posted: 10/15/2019