Prescient Edge is seeking a Full-Stack Data Engineerto support a Federal Government client.
Please note that the availability of this position is contingent upon contract award.
Benefits:
At Prescient Edge, we believe that acting with integrity and serving our employees is the key to everyone's success. To that end, we provide employees with a best-in-class benefits package that includes:
- A competitive salary with performance bonus opportunities.
- Comprehensive healthcare benefits, including medical, vision, dental, and orthodontia coverage.
- A substantial retirement plan with no vesting schedule.
- Career development opportunities, including on-the-job training, tuition reimbursement, and networking.
- A positive work environment where employees are respected, supported, and engaged.
Description:
- Proposed personnel possess the knowledge and capability to develop, maintain, and optimize an outward-facing data catalog that integrates geospatial and research data layers.
- Optimize data integration pipelines, API services, and front-end interfaces for accessing and visualizing geospatial and structured data.
- Must be proficient in full-stack development, database architecture, and API integration to enable seamless search, filtering, and rendering of structured research products.
- Must be proficient in Data Lakes splat forms such as Databricks, Kubernetes, ESRI ArcGIS environments, and cloud based data engineering.
- Expertise in building scalable, secure web applications, implementing metadata-driven search and retrieval features, and integrating APIs for seamless data interoperability is required.
- Shall establish and maintain metadata governance frameworks, ensuring compliance with DoD data management policies and interoperability with a Data Catalog.
- Shall develop automated metadata tagging processes to improve data discoverability, classification, and lineage tracking within the Common Intelligence Picture (CIP) platform.
- Shall implement and manage data governance workflows, ensuring integration with Open Lineage, Unity Catalog, and GIS metadata standards.
- Shall submit the Metadata & Data Governance Compliance Report, detailing lineage tracking, classification policies, and security enhancements.
- Shall develop and maintain the data pipeline infrastructure, ensuring scalable ingestion, transformation, and integration of structured and unstructured datasets within the cloud-based CIP platform.
- Shall optimize data storage strategies, implementing efficient query execution, indexing, and retrieval techniques for high-volume mission datasets.
- Shall integrate APIs for secure data sharing across operational environments, ensuring controlled access and compliance with security frameworks.
- Shall submit the Data Pipeline Optimization Report, detailing improvements in ingestion speed, storage efficiency, and API integrations.