St
49 data engineer databricks jobs found
Refine Search
Security Clearance
State
City
St
St
St
St
St
SP
St
St
MA
MA
MA
MA
MA
MA
- Experience supporting ICE contract work.
- Experience working in Design Intelligence.
- Bachelor’s Degree and 6 years of total experience or equivalent experience and education.
- 6 years direct experience in Data Engineering with experience in tools such as:
- Big data tools: Hadoop, Spark, Kafka, etc.
- Relational SQL and NoSQL databases, including Postgres and Cassandra.
- Data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
- AWS cloud services: EC2, S3, RDS, Glue, Step Functions, Lamda, EMR, DynamoDB, DocumentDB, Redshift, Aurora, Athena
- Data Platforms: Databricks, Snowflake
- Data streaming systems: Kafka, Storm, Spark-Streaming, etc.
- Languages: Python, R, Scala, Go
- Ability to inspect existing data pipelines, discern their purpose and functionality, and re-implement them efficiently in Databricks.
- Advanced working SQL knowledge and experience working with relational databases
- Advanced working knowledge and of NoSQL databases
- Experience with message queuing, stream processing, and highly scalable ‘big data’ data stores.
- Experience manipulating, processing, and extracting value from large, disconnected datasets.
- Experience manipulating structured and unstructured data for analysis.
- Experience with data modeling tools and processes.
- Experience aggregating and transforming data from multiple datasets to create data products
- Experience working in an Agile environment
Job ID
7923|McLean-VA
Security Clearance
Public Trust
About Steampunk