Job Opportunities API

The Public Ledger of Openings

← Back to the ledger

Software Engineer II, AI

Klue
CompanyKlue
CategoryEngineering
LocationToronto
RemoteOn-site (inferred)
EmploymentNot stated
LevelNot stated
SalaryUSD 115k
Posted7 Jul 2026
Last verified30 Jul 2026
SourceEmployer career page (ashby)
Applications are handled by the employer, not by us.Apply on the employer's site β†’
Description
AT KLUE https://klue.com/, WE’RE BUILDING THE FUTURE OF COMPETITIVE INTELLIGENCE πŸ‘‹ KLUE ENGINEERING IS HIRING! We're looking for a Software Engineer, AI to join our team in Toronto, focusing on building and optimizing state-of-the-art LLM-powered agents that can reason, plan and automate workflows for users. You'll be joining us at an exciting time as we reinvent our insight generation systems, making this an excellent opportunity for someone with strong Backend and ML fundamentals who wants to dive deep into practical LLM applications. As a member of our team, you'll be leading the design and implementation of search and retrieval agent systems that enable users to discover high-quality, relevant information with minimal effort. You will work at the intersection of LLM-powered agent workflows, retrieval pipelines, and evaluation frameworks, ensuring that our systems remain scalable, efficient, and aligned with user intent. WHAT YOU'LL DO - Design and implement retrieval-augmented generation (RAG) systems with agentic workflows to refine query understanding, document retrieval, and response synthesis. - Build and optimize retrieval pipelines using BM25, dense retrieval, hybrid retrieval, and re-ranking approaches. - Develop evaluation pipelines for retrieval and generation, including offline metrics (recall, MRR, nDCG) and human-in-the-loop evaluations. - Experiment with query rewriting, expansion, and classification to improve retrieval relevance. - Collaborate closely with Product to bring ML-powered search agents into production. - Profile, debug, and optimize the latency, accuracy, and scalability of retrieval and generation components. - Contribute to the design of data pipelines for training retrieval and ranking models, including dataset curation, augmentation, and labeling workflows. - Stay up-to-date with advancements in LLMs, retrieval techniques, and agent architectures, evaluating opportunities to integrate them into our systems. WHAT YOU BRING - Software engineering experience - Experience with information retrieval systems, search relevance, and ranking models - Expertise in Python, with experience in frameworks such as PyTorch, TensorFlow, or JAX. - Familiarity with LLMs, prompt engineering, and retrieval-augmented generation pipelines. - Understanding of evaluation methods for search systems, including offline metrics and user-facing evaluation. - Experience working with vector database infrastructure (FAISS, Milvus, Weaviate, Pinecone, PGVector) and traditional search engines (Elasticsearch, OpenSearch) - Understanding of data pipelines, preprocessing, and large-scale data handling. - Ability to work independently and collaboratively in a fast-paced environment, balancing research and production needs. - Develop and implement CI/CD pipelines. Automate the deployment and monitoring of ML models. - Knowledge of query understanding, document summarization and other content enrichment strategies - Expertise in automated LLM evaluation, including LLM-as-judge methodologies - Skilled at prompt engineering - including zero-shot, few-shot, and chain-of-thought. - Experience with cloud infrastructure (AWS, GCP, Azure) for scalable ML workflows. Nice to Have - Experience with agentic system design for LLM workflows. - Background in conversational search. - Contributions to open-source projects in the retrieval, NLP, or LLM ecosystems. WHAT SUCCESS LOOKS LIKE We're looking for builders who: - Take ownership and run with ambiguous problems - Jump into new areas and rapidly learn what's needed to deliver solutions - Bring scientific rigor while maintaining a pragmatic delivery focus - See unclear requirements as an opportunity to shape the solution OUR TECH STACK - LLM platforms: OpenAI, Anthropic, open-source models - ML frameworks: PyTorch, Transformers, spaCy - Search/Vector DBs: Elasticsearch, Pinecone, PostgreSQL - MLOp
HOUSE ADYou found the opening. Now track it.Tracker, radar and AI drafts in one place.erioun.com β†’
Software Engineer II, AI β€” Klue Β· Job Opportunities API