▷ High Salary: Data Engineer

Job Description Position Summary We are seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines, data lakes, and data marts that enable efficient data processing, transformation, and analytics. The ideal candidate has strong experience with PySpark, Microsoft Azure Fabric, and modern data engineering tools. Key Responsibilities Data Engineering: - Design, develop, and maintain data pipelines using PySpark and modern orchestration tools (Airflow, Prefect, or Dagster). - Manage large volumes of structured/unstructured data across multiple sources and formats. - Implement robust ELT processes, transformations, and mappings to ensure data quality and consistency. - Build and optimize data marts and analytical layers to support BI and advanced analytics. - Work with Microsoft Azure Fabric and related Azure services (Data Factory, Synapse, Data Lake, Power BI). - Ensure scalability, reliability, and security of the data platform following best practices. - Collaborate with analysts, data scientists, and stakeholders to deliver high-quality solutions. - Monitor, troubleshoot, and optimize pipeline performance. - Document data workflows and architecture for cross-team visibility. (Optional) Data Science & AI - Fine-tune and customize LLMs (OpenAI, Hugging Face, LLaMA) for business use cases. - Build and maintain data pipelines for ML training, evaluation, and monitoring. - Deploy models in containerized environments (Docker) and manage lifecycle using MLOps best practices (MLflow, DVC). - Integrate AI capabilities into products in collaboration with engineering teams. - Evaluate model performance, latency, and cost in production environments. Required Qualifications - The person should hold a Bachelor's or Master's degree in Computer Science. - The person must have strong proficiency with PySpark and distributed data processing frameworks. - The person should have experience with data pipeline orchestration tools (e.g., Airflow, Prefect, Dagster). - The person should be experienced in working with Microsoft Azure Fabric and the Azure ecosystem (Data Factory, Synapse, Data Lake, Power BI). - The person should be proficient in SQL and comfortable working with relational and non-relational databases. - The person should have a solid understanding of data modeling, data warehousing, and ELT principles. - The person must have strong coding skills in Python and familiarity with version control systems (Git). - The person should have knowledge of data governance, security, and compliance frameworks. - The person should be familiar with streaming data frameworks (Kafka, Event Hubs). Good to Have - 4+ years in Data Engineering or ML/Data Science roles. - Hands-on experience with LLMs, NLP models, or foundational model APIs. - Experience with ML libraries (Transformers, LangChain, scikit-learn, Pandas). - Familiarity with containerized deployment (Docker) and scalable ML infrastructure. - Experience with vector databases (Pinecone, Weaviate, Qdrant). - Knowledge of model-serving frameworks (FastAPI, Triton, Ray Serve). - Exposure to GPU infrastructure for distributed model training. - Experience with CI/CD, automated testing, and infrastructure as code. About Aumni - Aumni, established in 2016, is a Software Services Company that partners with Product companies to build and manage their dedicated teams in India. - So, while you are working for a services company, you are working within a product team and growing with them. - These are not projects but product development, and we have long term (open ended) contracts with our clients. When our clients sign up with us, they are looking at a multi-year relationship. Most of our clients have been with 6,8,9 years. - We do not move people across client teams and there is no concept of bench. - At Aumni, we believe in quality work, and we truly believe that Indian talent is at par with global talent from US or Europe. - We are 350+ and growing Benefits Of Working At Aumni - Our award winning culture reminds us of our engineering days. - Medical insurance (including Parents), Life and disability insurance - 24 leaves + 10 public holidays + leaves for Hospitalisation, maternity, paternity and bereavement. - On site Gym, TT, Carrom, Foosball and Pool - Hybrid work culture - Fitness group / rewards - Aumni Premier League, Aumni's Got Talent, Friday Socials, Annual parties, treks. Aumni Values BE BOLD - Dare to innovate, challenge the norm and take ownership. Growth comes from courage. BE TRUE - Act with integrity and transparency - in every task, every decision and every interaction. BE KIND - Respect people, embrace diversity and support our culture of empathy and high collaboration. BE YOU - Bring your authentic self to work. Have fun working, celebrate individuality and create space for everyone to thrive.