Big Data Operations Engineer (360511) McLean, Virginia


Job Title: Big Data Operations Engineer

As an experienced Big Data Engineer, your mission is to help lead our team of innovators and technologists toward creating next-level solutions that improve the way our business is run. Your deep knowledge of design, analytics, development, coding, testing and application programming will help your team raise their game, meeting your standards, as well as satisfying both business and functional requirements. Your expertise in various technology domains will be counted on to set strategic direction and solve complex and mission critical problems, internally and externally. Your quest to embracing leading-edge technologies and methodologies inspires your team to follow suit. And best of all, you’ll be able to harness massive amounts of brainpower through our global network of technologists from around the world.
Must Have:

  • Good working knowledge of Data Management Systems
  • Hands on experience with Unix shell scripting
  • Good working knowledge of scripting languages Spark, Python
  • Hands on experience with Job schedulers Apache Oozie and AutoSys
  • Strong troubleshooting skills


Nice to Have

  • Working knowledge of AWS native tools
  • Hortonworks/Cloudera or AWS certifications
  • Bachelor's Degree or better in Engineering, Computer Science or Information Technology
  • Cloud Computing
  • BigData, Hadoop, Hive
  • ODS - Cassandra
  • Java 8 / Spark
  • ETL - Talend
  • Real time messaging – Kafka / Java on Gaia Application Platform
  • Exposure to Machine Learning will be a big +
  • 3+ years of experience in middle-tier/backend systems development in Java/Linux
  • Big data background with experience designing and implementing large scale systems
  • Working experience with Hadoop, Enterprise Java development, NoSQL data platforms (Cassandra), Pub/sub messaging (Rendezvous, AMPS, Kafka, etc.), Stream processing (Storm, Hbase, Nifi, Spark Streaming, etc.), Batch Processing with tools such as Talend, Informatica, or Hive/SQL and Visualization with Tableau.
  • Extensive experience with horizontally scalable and highly available system design and implementation, with focus on performance and resiliency
  • Extensive experience profiling, debugging, and performance tuning complex distributed systems
  • Willingness to commit extra effort to meet deadlines as required on a high profile and business critical project
;