Data Engineer

4 weeks ago

kolkata, India Mejoba Consulting Full time

Job description :

We seek a talented Data Engineer with expertise in Robotic Process Automation (RPA) and Artificial Intelligence/Machine Learning (AI/ML) to join our dynamic team.

As a Data Engineer with RPA and AI/ML expertise, you will play a crucial role in designing, implementing, and maintaining data pipelines, workflows, and automation solutions.

You will be responsible for developing and fine-tuning LLM models with expertise in RAG (Retrieval-Augmented Generation), content extraction, and familiarity with the concept of local LLMs.

You will work closely with our Data Engineering team to innovate and optimize LLM models and collaborate closely with cross-functional teams to integrate RPA infrastructure, enabling clients to automate existing processes.

Role & responsibilities :

- Develop and optimize LLM models using state-of-the-art techniques, focusing on RAG (Retrieval-Augmented Generation).

- Implement content extraction methods to enhance the accuracy and relevance of generated responses.

- Collaborate with cross-functional teams to identify and address LLM development and deployment challenges.

- Stay updated with the latest advancements in natural language processing (NLP) and machine learning research.

- Provide technical guidance and mentorship to junior team members.

- Contribute to documenting and disseminating best practices in LLM development and deployment.

- Implement RPA solutions to automate repetitive tasks and improve operational efficiency

- Collaborate with data scientists and business analysts to understand data requirements and translate them into technical solutions.

- Monitor performance, troubleshoot issues, and optimize data workflows for scalability and reliability

- Stay up-to-date with the latest trends and technologies in data engineering, RPA, and AI/ML

Required Skill Sets :

- Bachelor's or higher degree in Computer Science, Engineering, or a related field.

- Proven experience in developing and fine-tuning LLM models, preferably with a focus on RAG.

- Hands-on experience with RPA tools such as UiPath, Automation Anywhere, Blue Prism, Power Automate

- Strong proficiency in Python programming and familiarity with relevant libraries/frameworks such as TensorFlow, PyTorch, scikit-learn.

- Solid understanding of natural language processing (NLP) fundamentals and machine learning principles.

- Experience with content extraction techniques such as Named Entity Recognition (NER), text summarization, and information retrieval.

- Familiarity with the concept of local LLMs and their applications in specific domains or languages.

- Excellent problem-solving skills and the ability to work effectively in a collaborative team environment.

- Strong communication skills with the ability to explain complex technical concepts to non-technical stakeholders.

Preferred Qualifications :

- Experience with cloud platforms such as AWS, Azure, or Google Cloud

- Prior working knowledge in implementing RPA and AI/ ML Methods.

- Certification in RPA or AI/ML technologies.

- Contributions to open-source projects related to natural language processing or machine learning.

- Knowledge of big data technologies (e.g., Hadoop, Spark, Kafka)

(ref:hirist.tech)

  • Manager- Data center operations

    5 days ago

    kolkata, India NTT DATA Full time

    Job Description NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future. In today’s ‘iNTTerconnected’ world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help...

  • Manager- Data center operations

    5 days ago

    Kolkata, India NTT DATA Full time

    Job Description NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future.In today’s ‘iNTTerconnected’ world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help our...

  • Data Engineer

    6 days ago

    kolkata, India Webologix Ltd INC Full time

    Job Position: Data engineer with AWS CloudJob Type: Full-TimeLocation: KolkataExperience: - 5+ to 10+ YearsMust Have: Aws-Data-Services, AWS Cloud, Data engineer.Key ResponsibilitiesAWS AuroraAWS RDSAWS Dynamo DBAWS S3AWS LambdaAWS GlueAWS Step FunctionsAWS Event BridgeAWS DMSAWS SCTData MigrationPythonPySparkSQLEducation:B. Tech or equivalent IT Degree.

  • Data Engineer

    6 days ago

    Kolkata, India Webologix Ltd INC Full time

    Job Position: Data engineer with AWS Cloud Job Type: Full-TimeLocation: KolkataExperience: - 5+ to 10+ YearsMust Have: Aws-Data-Services, AWS Cloud, Data engineer.Key ResponsibilitiesAWS AuroraAWS RDSAWS Dynamo DBAWS S3AWS LambdaAWS GlueAWS Step FunctionsAWS Event BridgeAWS DMSAWS SCTData MigrationPythonPySparkSQLEducation: B. Tech or equivalent IT Degree.

  • Data Engineer

    6 days ago

    kolkata, India Webologix Ltd INC Full time

    Job Position: Data engineer with AWS Cloud Job Type: Full-Time Location: Kolkata Experience: - 5+ to 10+ Years Must Have: Aws-Data-Services, AWS Cloud, Data engineer. Key Responsibilities AWS Aurora AWS RDS AWS Dynamo DB AWS S3 AWS Lambda AWS Glue AWS Step Functions AWS Event Bridge AWS DMS AWS SCT Data Migration Python PySpark SQL ...

  • Data Engineer

    5 days ago

    Kolkata, India Webologix Ltd INC Full time

    Job Position: Data engineer with AWS Cloud Job Type: Full-TimeLocation: KolkataExperience: - 5+ to 10+ YearsMust Have: Aws-Data-Services, AWS Cloud, Data engineer.Key ResponsibilitiesAWS AuroraAWS RDSAWS Dynamo DBAWS S3AWS LambdaAWS GlueAWS Step FunctionsAWS Event BridgeAWS DMSAWS SCTData MigrationPythonPySparkSQLEducation: B. Tech or equivalent IT Degree.

  • Data Engineer

    2 days ago

    Kolkata, India LTIMindtree Full time

    Position: Azure Data Engineer Location: Hyderabad / Chennai / Pune / Mumbai / Bangalore / Kolkata Experience: 8 - 16 Years only Must have minimum of 6 Years of Database Experience with Azure cloud experience Must have Data Mesh Data products implementation experience Must have Data Governance Solution Experience Metadata Management Data Quality Lineage...

  • Data Engineer

    2 weeks ago

    kolkata, India HTD Resources Full time

    Skill: Data Engineer with Python knowledge Designation : Software Engineer Relevant Experience: 5 - 6 years Mandatory Skills: Primary Skills - Python, SQL, AWS, DWH Concept, ELT, Secondary Skills - GCP, CDC Location: Mumbai / Kolkata Mode: Work from Office Interview Rounds: 3-4 Rounds

  • Senior Data Engineer

    1 month ago

    Kolkata, India FinArb Consulting Full time

    ResponsibilitiesWe are looking for a for a strong self-driven Senior Data Engineer to join the team of data and software ­­­engineeringPrimary responsibilities would include:Investigate source data systems to build comprehensive data models to serve as Single Source of TruthDesign and implement flexible, robust & scalable ETL infrastructureDeploy...

  • Software Engineer-Data Engineer

    1 month ago

    Kolkata, India CliniSys Full time

    Essential FunctionsExtract data from on-prem databases using appropriate tools and techniques.Transform and clean the data to ensure its suitability for PowerBI analysis.Build and maintain data pipelines for regular data refresh in PowerBI.Monitor and maintain Azure Synapse pipelines for on-prem data extraction and transformation.Collaborate with analysts to...

  • Senior Engineer

    3 days ago

    Kolkata, India NTT DATA Full time

    Job Description NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future.In today’s ‘iNTTerconnected’ world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help our...

  • Senior Engineer

    1 day ago

    kolkata, India NTT DATA Full time

    Job Description NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future. In today’s ‘iNTTerconnected’ world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help...

  • Senior Data Engineer

    1 month ago

    kolkata, India FinArb Consulting Full time

    Responsibilities We are looking for a for a strong self-driven Senior Data Engineer to join the team of data and software ­­­engineering   Primary responsibilities would include:     Investigate source data systems to build comprehensive data models to serve as Single Source of Truth Design and implement flexible, robust & scalable ETL...

  • Senior Data Engineer

    1 month ago

    Kolkata, India FinArb Consulting Full time

    ResponsibilitiesWe are looking for a for a strong self-driven Senior Data Engineer to join the team of data and software ­­­engineering Primary responsibilities would include:   Investigate source data systems to build comprehensive data models to serve as Single Source of TruthDesign and implement flexible, robust & scalable ETL infrastructureDeploy...

  • ▷ Apply Now: Data Engineer

    5 days ago

    Kolkata, India Webologix Ltd INC Full time

    Job Position: Data engineer with AWS CloudJob Type: Full-TimeLocation: KolkataExperience: - 5+ to 10+ YearsMust Have: Aws-Data-Services, AWS Cloud, Data engineer.Key Responsibilities- AWS Aurora- AWS RDS- AWS Dynamo DB- AWS S3- AWS Lambda- AWS Glue- AWS Step Functions- AWS Event Bridge- AWS DMS- AWS SCT- Data Migration- Python- PySpark- SQLEducation:- B....

  • Hiring For Data Engineer- Databricks Azure Data Factory Python

    3 weeks ago

    Kolkata, West Bengal, India timesjobs Full time

    Hiring For Data Engineer- Databricks Azure Data Factory Python Job Description Data Engineer- Databricks Azure Data Factory Python Desired Profile Skills: Azure Databricks Azure Data Factory Python, implementing both structured and unstructured data, Data migration solutions, Data Warehousing, Data processing / ETL / Big data, Hadoop, Java, Spark, Scala, and...

  • Hiring For Data Engineer- Databricks Azure Data Factory Python

    3 weeks ago

    Kolkata, India timesjobs Full time

    Hiring For Data Engineer- Databricks Azure Data Factory Python Job Description Data Engineer- Databricks Azure Data Factory Python Desired Profile Skills: Azure Databricks Azure Data Factory Python, implementing both structured and unstructured data, Data migration solutions, Data Warehousing, Data processing / ETL / Big data, Hadoop, Java, Spark,...

  • Azure Data Engineer

    3 weeks ago

    Kolkata, India LTIMindtree Full time

    Position: Azure Data EngineerLocation: Hyderabad / Chennai / Pune / Mumbai / Bangalore / KolkataExperience: 8 - 16 Years onlyMust have minimum of 6 Years of Database Experience with Azure cloud experienceMust have Data Mesh Data products implementation experienceMust have Data Governance Solution Experience Metadata Management Data Quality Lineage...

  • Azure Data Engineer

    3 weeks ago

    Kolkata, India LTIMindtree Full time

    Position: Azure Data EngineerLocation: Hyderabad / Chennai / Pune / Mumbai / Bangalore / KolkataExperience: 8 - 16 Years onlyMust have minimum of 6 Years of Database Experience with Azure cloud experienceMust have Data Mesh Data products implementation experienceMust have Data Governance Solution Experience Metadata Management Data Quality Lineage...

  • Lead Consultant-Data Bricks Engineer

    4 days ago

    Kolkata, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...