Data Engineer

6 days ago

Kolkata, India Sun Dew Solutions Private Limited Full time

Job Description

Role responsibilities

- Develop and optimize LLM models using state-of-the-art techniques, focusing on RAG (Retrieval-Augmented Generation).
- Implement content extraction methods to enhance the accuracy and relevance of generated responses.
- Collaborate with cross-functional teams to identify and address LLM development and deployment challenges.
- Stay updated with the latest advancements in natural language processing (NLP) and machine learning research.
- Provide technical guidance and mentorship to junior team members.
- Contribute to documenting and disseminating best practices in LLM development and deployment.
- Implement RPA solutions to automate repetitive tasks and improve operational efficiency.
- Collaborate with data scientists and business analysts to understand data requirements and translate them into technical solutions.
- Monitor performance, troubleshoot issues, and optimize data workflows for scalability and reliability
- Stay up-to-date with the latest trends and technologies in data engineering, RPA, and AI/ML

Required Skill Sets:

- Bachelors or higher degree in Computer Science, Engineering, or a related field.
- Proven experience in developing and fine-tuning LLM models, preferably with a focus on RAG.
- Hands-on experience with RPA tools such as UiPath, Automation Anywhere, Blue Prism, Power Automate
- Strong proficiency in Python programming and familiarity with relevant libraries/frameworks such as TensorFlow, PyTorch, scikit-learn.
- Solid understanding of natural language processing (NLP) fundamentals and machine learning principles.
- Experience with content extraction techniques such as Named Entity Recognition (NER), text summarization, and information retrieval.
- Familiarity with the concept of local LLMs and their applications in specific domains or languages.
- Excellent problem-solving skills and the ability to work effectively in a collaborative team environment.
- Strong communication skills with the ability to explain complex technical concepts to non-technical stakeholders

Preferred Qualifications:

- Experience with cloud platforms such as AWS, Azure, or Google Cloud
- Prior working knowledge in implementing RPA and AI/ ML Methods.
- Certification in RPA or AI/ML technologies.
- Contributions to open-source projects related to natural language processing or machine learning.
- Knowledge of big data technologies (e.g., Hadoop, Spark, Kafka)

  • Lead Data Engineer

    3 days ago

    Greater Kolkata Area, India Eucloid Data Solutions Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job DescriptionEucloid is looking for a senior/ lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to...

  • Machine Learning Engineer

    1 week ago

    Kolkata, India Applied Data Finance Full time

    Key Responsibilities. Collaborate with data scientists to support end-to-end ML model development, including data preparation, feature engineering, training, and evaluation.. Build and maintain automated pipelines for data ingestion, transformation, and model scoring using Python and SQL.. Assist in model deployment using CI/CD pipelines (e.g.,...

  • Data engineer

    3 weeks ago

    Kolkata, West Bengal, India AQb Solutions Pvt Ltd Full time

    We are looking for a highly skilled Data Engineer with strong expertise in Postgre SQL and hands-on experience in building data warehouses and data lakes. In this role, you will design and implement a scalable Postgre SQL-based data warehouse and manage a data lake on AWS infrastructure, leveraging primarily open-source technologies.The ideal candidate has a...

  • Data Engineer

    3 weeks ago

    Kolkata, West Bengal, India NP Group Full time

    Data Engineer - Palantir Foundry, Workshop, Pyspark & TypescriptFully Remote 6 month full time contractRate: $15.00 per hourWe have an immediate requirement for an experienced Data Engineer to join the global engineering team for a International Enterprise Organisation.You will bring Data Engineering expertise onto greenfield multi year project...

  • Data Engineer

    3 weeks ago

    Kolkata, West Bengal, India SentinentGeeks Software & Consultancy Pvt Ltd Full time

    Role DescriptionThis is a full-time role for a Data Engineer. The Data Engineer will design, develop, and maintain data architecture, including databases and large-scale data processing systems. Day-to-day tasks will include ETL development, data integration, performance tuning, ensuring data quality and integrity, and creating data pipelines. The role also...

  • Data Engineer With Data Operations

    3 weeks ago

    Kolkata, West Bengal, India ADV TECHMINDS Full time

    Job Title Data Engineer with Data OperationsExperience 5 Years Employment Type Contract Duration 6 Months Extendable Location KolkataKey Responsibilities Design develop and maintain robust data pipelines to support data integration from Oracle Flexcube and other data sources into the Cloudera Data Platform Utilize Hadoop for efficient data...

  • Senior Data Analyst Tableau

    1 week ago

    Kolkata, West Bengal, India Applied Data Finance Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    About The RoleWe are looking for a talented and motivated Senior Data Analyst to join our Marketing and Product Analytics teamIn this role, you will work closely with cross-functional teams to analyse data, build models, and generate insights that drive key decisions across our marketing and product functionsThis is a fantastic opportunity to apply your...

  • Senior Data Analyst Tableau

    1 week ago

    Kolkata, India Applied Data Finance Full time

    About The Role We are looking for a talented and motivated Senior Data Analyst to join our Marketing and Product Analytics team In this role, you will work closely with cross-functional teams to analyse data, build models, and generate insights that drive key decisions across our marketing and product functions This is a fantastic opportunity to apply your...

  • Leading Data Engineer

    2 weeks ago

    Kolkata, West Bengal, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Data Engineering ExpertThe primary objective of this senior-level position is to design, build, and maintain high-quality data pipelines and validation processes. In this capacity, the successful candidate will have an extensive understanding of scalable data quality management systems.Key Responsibilities:Develop and implement robust data quality...

  • Senior Data Scientist Machine Learning Statistical Modeling

    1 week ago

    Kolkata, India Applied Data Finance Full time

    About The Role- We are looking for a talented and motivated Senior Data Scientist to join our Marketing and Product Analytics team- In this role, you will work closely with cross-functional teams to analyse data, build models, and generate insights that drive key decisions across our marketing and product functions- This is a fantastic opportunity to apply...