Software Developer, AI/ML - Mid to Senior

Researches, designs, develops, and modifies enterprise-wide systems and applications software with an emphasis on artificial intelligence and machine learning capabilities. Builds and integrates large language model services, natural language processing pipelines, and retrieval systems that turn large volumes of unstructured documents into searchable, analyzable, and conversational intelligence. Participates in planning for system and development deployment and is responsible for meeting software compliance standards. Evaluates the interface between hardware and software, operational requirements, and characteristics of the overall system. Documents testing and maintenance of system corrections.

This position supports a document intelligence and analysis platform spanning a React/TypeScript analytic dashboard, Java microservices, Python AI services, and Elasticsearch and Neo4j data stores, deployed in a containerized on-premise environment.

Mid-Level Software Developer Job Duties:

• Experience developing software using Agile processes

• Develop and integrate LLM-backed capabilities using AnythingLLM as the chat backend, including workspace, thread, and streaming-chat REST endpoints supporting an analytic chat assistant and an LMS training assistant

• Configure and work across pluggable model providers - Ollama, OpenAI, Azure OpenAI, Anthropic, Mistral, LM Studio, LiteLLM, NVIDIA NIM, and others - with model and workspace selection driven by runtime environment configuration rather than hard-coded values, supporting deployment into disconnected and constrained environments

• Build retrieval-augmented generation workflows: embedding and vector store configuration, document chunking, context assembly, source attribution, and prompt and system-prompt development

• Develop and maintain Python AI/NLP services using FastAPI, Uvicorn, and Pydantic, including entity extraction and analysis (spaCy, NLTK) and coreference resolution (AllenNLP, PyTorch, Transformers, scikit-learn)

• Build Java microservices for ingestion, enrichment, alerting, and query that prepare and serve data to the AI layer

• Develop document processing pipelines that convert Word, Excel, PDF, and other formats into structured, model-ready text (Apache Tika, PDFBox, Apache POI)

• Implement search, indexing, and hybrid retrieval against Elasticsearch, and model entity relationships in Neo4j to support graph-aware analysis

• Build AI-facing user interfaces including streaming chat, source citation, human-in-the-loop review, and data-dense visualization of model output and entity relationships

• Tune streaming performance end to end, from reverse-proxy buffering and timeout configuration through token rendering in the browser

• Develop evaluation and regression testing approaches that make model and retrieval quality measurable over time

• Experience using tools such as: 

  • TypeScript

  • React

  • MUI (Material UI)

  • Vite

  • D3, Recharts, React Flow (xyflow), Leaflet / ArcGIS

  • Elasticsearch

  • Neo4j

  • Java 17 with Vert.x

  • Apache Tika, PDFBox, Apache POI

  • Python, FastAPI, Pydantic

  • spaCy, NLTK, PyTorch, Transformers

  • AnythingLLM

  • Ollama or comparable self-hosted model runtimes

  • Keycloak, Nginx

• Experience building cloud-based applications not required, but great to have

Mid-Level Software Developer Education and Experience:

• 9-11 years of experience with a bachelor's degree

• 7-9 years of experience with a master's degree

Senior Software Developer Job Duties:

• Same as mid-level duties above, plus:

• Own significant portions of the AI stack, including architecture decisions on model integration, retrieval strategy, and evaluation methodology

• Lead performance, reliability, and quality improvement efforts across LLM and ML services, and establish baselines against which improvements are measured

• Provide technical guidance and mentorship to mid-level developers on AI/ML implementation practices

• Experience using tools such as: Git, Jenkins, Docker, JIRA, Confluence

• Experience building cloud-based applications not required, but great to have

Senior-Level Software Developer Education and Experience:

• 12+ years of experience with a bachelor's degree

• 10+ years of experience with a master's degree

Security Clearance:

• Active TS/SCI Clearance and the willingness to sit for a CI polygraph, if needed

IC-CAP provides equal employment opportunities (EEO) to all applicants for employment without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, disability, genetic information, marital status.