ETL Developer

  • Recro
  • Chantilly, VA, USA
  • Mar 26, 2020
Full time Information Technology Telecommunications

Job Description

Summary

The successful candidate will leverage their development skills and experience, as part of our Sponsor's Data Layer Engineering Team, to support the successful ingestion, cleansing, transformation, loading, and display of significant amounts of data.

Duties, Tasks & Responsibilities

  • Designing and implementing large-scale ingest systems in a Big Data environment
  • Optimizing all stages of the data lifecycle, from initial planning, to ingest, through final display and beyond
  • Designing and implementing data extraction, cleansing, transformation, loading, and replication/distribution
  • Developing custom solutions/code to ingest and exploit new and existing data sources
  • Working with Sponsor development teams to improve application performance
  • Organizing and maintaining Data Layer documentation, so others are able to understand and use it
  • Collaborating with teammates, other service providers, vendors, and users to develop new and more efficient methods

Required Experience, Skills, & Technologies

  • Bachelor's Degree in Computer Science, Information Systems, Engineering, or other related discipline, OR 10 years of related software development experience may be substituted for education
  • At least 5 years of data analysis and parsing experience
  • At least 5 years of Java development experience coupled with significant SQL/database experience
  • Strong experience with the full data lifecycle, from ingest through display, in a Big Data environment
  • Strong experience with Java-related technologies, such as JDK, J2EE, EJB, JDBC, and/or Spring, and experience with RESTful APIs
  • Experience with Hadoop, Hbase, MapReduce
  • Experience with Kafka and Zookeeper
  • Experience developing and performing ETL tasks in a Linux environment
  • TS/SCI with Polygraph

Desired Experience, Skills & Technologies

Experience with Elasticsearch

Security Requirements:

  • Active TS/SCI w/Polygraph