Data Engineer

# Data Engineer - Sampling JIO ## Company Overview *(Company information is not specified.)* ## Job Summary The Data Engineer will be responsible for designing and implementing core data pipelines and semantic data models for the AI Platform. This role is crucial for enabling high-quality data retrieval, grounding, and minimizing hallucination effects in multi-domain Large Language Model (LLM) applications. ## Responsibilities - Design and implement core data pipelines and semantic data models. - Ensure high-quality data retrieval and grounding for AI applications. - Minimize hallucination in multi-domain LLM applications. - Collaborate with data science teams to enhance data-driven functionalities. - Optimize and maintain existing data pipelines for performance and reliability. ## Qualifications - 5+ years of experience in data engineering or data science. - Strong proficiency in **Python** and **SQL**. - Experience with **ETL/ELT** systems. - Hands-on experience with **GraphQL** schema design. - Familiarity with at least one **vector database** (e.g., Pinecone, Milvus, Weaviate, FAISS). - Solid understanding of concepts such as **embeddings**, **chunking**, **metadata enrichment**, and **retrieval pipelines**. - Experience with **Airflow**, **Spark**, **Flink**, or similar data processing systems. - Bachelor's degree in Computer Science, Data Science, or a related field is preferred. ## Preferred Skills - Familiarity with machine learning frameworks and tools. - Experience in cloud platforms such as AWS, Google Cloud, or Azure. - Knowledge of data governance and best practices in data management. ## Experience - Minimum of **5 years** in data engineering or data science roles. ## Environment *(Work environment details are not specified.)* ## Salary *(Salary details are not specified.)* ## Growth Opportunities *(Career advancement opportunities are not specified.)* ## Benefits *(Benefits information is not specified.)*