The Sponsor requires a team to provide operations and maintenance as well as new development work for existing applications. The Sponsor’s office is a central data processor and applications developer for applications that utilize travel data. The Sponsor aims to establish support to travel data applications and the associated backend environment while that travel data undergoes a transition period and is ingested into new environments and user applications. As these travel applications analytic capabilities continue to be absorbed, this team will need to provide ongoing support and development to travel data models and travel data ETL pipelines.
Responsibilities
- Operations and Maintenance (O&M):
- Identify and facilitate the collection and monitoring of system performance, availability metrics, and travel data parsing metrics, as well as other pertinent usage metrics required by the Sponsor, to determine the usage and value of the application
- Ensure that database and software maintenance activities, including those related to travel data parsing, are completed, and that application performance, especially in the context of processing travel data, does not degrade over time
- Monitor storage allocation and usage against planned data growth, including travel data, to ensure current and future storage needs are identified and allocated by appropriate system maintenance personnel in order to prevent any operational impacts related to travel data integration
- Continue parsing data for external Sponsor partners
- Recommend changes or upgrades, including enhancements for travel data parsing capabilities, that need to be made to handle increased loads of data, growth of the user base, or other changes over the life of the application
- Recommend termination or integration of functionality, including aspects related to travel data processing, with other applications to maximize the use of limited resources effectively
- Coordinate with additional Sponsor offices (when applicable) to track expirations and support renewals of hardware and software licenses used by Sponsor applications
- Coordinate with the Sponsor to monitor expirations of server and application-level certificates to ensure continuity of operations and take action to ensure they are renewed as necessary
- Tier 3 Support:
- Conduct thorough and rapid investigation of high priority software trouble tickets and reports to determine the cause and severity of system issues. This effort includes the review of system and application logs and the review of system fault alerts and messages.
- Attempt to replicate system issues in the Sponsor’s development, integration and test environments using operational data where appropriate
- Coordinate high priority software bug fixes and patches with any external application providers, vendors, and other Sponsor partner organizations as necessary
- Modernization/Development:
- At the Sponsor’s direction and approval, be responsible for supporting the transition of operational travel applications. This transition is part of a comprehensive and systematic approach to consolidating the Sponsor’s travel data capabilities within the existing ecosystem. The transition will adhere to deadlines and timelines at the discretion of the Sponsor.
- Develop software transition plans (i.e., deployment procedures) and data validation and migration plan and support the execution of those plans
- Prepare and present briefings to seek approval from Sponsor mission partners and Group management
- Set up and conduct project meetings with other Sponsor divisions as necessary to coordinate work and integrate schedules
- Develop technical approaches, validate design plans, and conduct feasibility studies
- Perform lessons learned sessions for Sponsor management and project teams at appropriate intervals
- Perform assessment and accreditation activities in support of existing systems in accordance with the Sponsor’s Assessment and Authorization (A&A) process
Requirements
- TS/SCI FSP Clearance
- Demonstrated experience building and managing data pipelines
- Demonstrated experience with Python
- Demonstrated experience with cloud computing using AWS services
- Demonstrated experience processing data using Apache Spark
- Demonstrated experience with an RDBMS (Relational Database Management System) (Postgres, Oracle, MySQL) and writing SQL queries
- Demonstrated experience with Linux and shell scripting
- Demonstrated experience analyzing data in different file formats like csv, xml, json, avro, parquet, etc.
- Demonstrated experience writing and validating unit tests
Desired Skills
- Demonstrated experience in NiFi, Apache AirFlow, or an equivalent solution or tool for orchestrating data pipelines
- Demonstrated experience with java or scala
- Demonstrated experience administering an EMR/Spark cluster
- Demonstrated experience conducting performance tuning of a spark job
- Demonstrated experience supporting Hive, Iceberg, or another technology providing SQL access to data
- Demonstrated experience developing cloud-based security solutions
- Demonstrated experience following a configuration management process to review and deploy code as part of releases
About Us
For more than 20 years, NewGen Technologies has solved our clients’ toughest IT challenges with integrity, security, and outstanding service by delivering both technology and talent. We have helped secure borders, have used artificial intelligence (AI) to fight terror, aided the identification of criminals, and have helped to prevent crime through the introduction of biometrics. Our team of Highly Cleared Specialists have hard-to-find skills and expertise in a wide spectrum of technologies to provide solutions that transform business processes and solve problems of national significance. #CJ
