Data Engineer

4 weeks ago

Kolkata, India Mejoba Consulting Full time

Job description :

We seek a talented Data Engineer with expertise in Robotic Process Automation (RPA) and Artificial Intelligence/Machine Learning (AI/ML) to join our dynamic team.

As a Data Engineer with RPA and AI/ML expertise, you will play a crucial role in designing, implementing, and maintaining data pipelines, workflows, and automation solutions.

You will be responsible for developing and fine-tuning LLM models with expertise in RAG (Retrieval-Augmented Generation), content extraction, and familiarity with the concept of local LLMs.

You will work closely with our Data Engineering team to innovate and optimize LLM models and collaborate closely with cross-functional teams to integrate RPA infrastructure, enabling clients to automate existing processes.

Role & responsibilities :

- Develop and optimize LLM models using state-of-the-art techniques, focusing on RAG (Retrieval-Augmented Generation).

- Implement content extraction methods to enhance the accuracy and relevance of generated responses.

- Collaborate with cross-functional teams to identify and address LLM development and deployment challenges.

- Stay updated with the latest advancements in natural language processing (NLP) and machine learning research.

- Provide technical guidance and mentorship to junior team members.

- Contribute to documenting and disseminating best practices in LLM development and deployment.

- Implement RPA solutions to automate repetitive tasks and improve operational efficiency

- Collaborate with data scientists and business analysts to understand data requirements and translate them into technical solutions.

- Monitor performance, troubleshoot issues, and optimize data workflows for scalability and reliability

- Stay up-to-date with the latest trends and technologies in data engineering, RPA, and AI/ML

Required Skill Sets :

- Bachelor's or higher degree in Computer Science, Engineering, or a related field.

- Proven experience in developing and fine-tuning LLM models, preferably with a focus on RAG.

- Hands-on experience with RPA tools such as UiPath, Automation Anywhere, Blue Prism, Power Automate

- Strong proficiency in Python programming and familiarity with relevant libraries/frameworks such as TensorFlow, PyTorch, scikit-learn.

- Solid understanding of natural language processing (NLP) fundamentals and machine learning principles.

- Experience with content extraction techniques such as Named Entity Recognition (NER), text summarization, and information retrieval.

- Familiarity with the concept of local LLMs and their applications in specific domains or languages.

- Excellent problem-solving skills and the ability to work effectively in a collaborative team environment.

- Strong communication skills with the ability to explain complex technical concepts to non-technical stakeholders.

Preferred Qualifications :

- Experience with cloud platforms such as AWS, Azure, or Google Cloud

- Prior working knowledge in implementing RPA and AI/ ML Methods.

- Certification in RPA or AI/ML technologies.

- Contributions to open-source projects related to natural language processing or machine learning.

- Knowledge of big data technologies (e.g., Hadoop, Spark, Kafka)

(ref:hirist.tech)

  • Specialist Data center operations

    4 weeks ago

    Kolkata, India NTT DATA Full time

    The role of Critical Facilities Maintenance Engineer is responsible for working with all major systems within a facility or building such as electrical and HVAC systems and performs regular maintenance on all systems. This position performs hands-on operations and maintenance which includes all physical and administrative operations tasks, service, and...

  • Specialist Data center operations

    4 weeks ago

    Kolkata, India NTT DATA Full time

    The role of Critical Facilities Maintenance Engineer is responsible for working with all major systems within a facility or building such as electrical and HVAC systems and performs regular maintenance on all systems. This position performs hands-on operations and maintenance which includes all physical and administrative operations tasks, service, and...

  • Data Engineer

    2 days ago

    kolkata, India HTD Resources Full time

    Skill: Data Engineer with Python knowledge Designation : Software Engineer Relevant Experience: 5 - 6 years Mandatory Skills: Primary Skills - Python, SQL, AWS, DWH Concept, ELT, Secondary Skills - GCP, CDC Location: Mumbai / Kolkata Mode: Work from Office Interview Rounds: 3-4 Rounds

  • Software Engineer-Data Engineer

    3 weeks ago

    Kolkata, India CliniSys Full time

    Essential FunctionsExtract data from on-prem databases using appropriate tools and techniques.Transform and clean the data to ensure its suitability for PowerBI analysis.Build and maintain data pipelines for regular data refresh in PowerBI.Monitor and maintain Azure Synapse pipelines for on-prem data extraction and transformation.Collaborate with analysts to...

  • Senior Data Engineer

    3 weeks ago

    Kolkata, India FinArb Consulting Full time

    ResponsibilitiesWe are looking for a for a strong self-driven Senior Data Engineer to join the team of data and software ­­­engineeringPrimary responsibilities would include:Investigate source data systems to build comprehensive data models to serve as Single Source of TruthDesign and implement flexible, robust & scalable ETL infrastructureDeploy...

  • Senior Data Engineer

    3 weeks ago

    Kolkata, India FinArb Consulting Full time

    ResponsibilitiesWe are looking for a for a strong self-driven Senior Data Engineer to join the team of data and software ­­­engineering Primary responsibilities would include:   Investigate source data systems to build comprehensive data models to serve as Single Source of TruthDesign and implement flexible, robust & scalable ETL infrastructureDeploy...

  • Senior Data Engineer

    3 weeks ago

    kolkata, India FinArb Consulting Full time

    Responsibilities We are looking for a for a strong self-driven Senior Data Engineer to join the team of data and software ­­­engineering   Primary responsibilities would include:     Investigate source data systems to build comprehensive data models to serve as Single Source of Truth Design and implement flexible, robust & scalable ETL...

  • Hiring For Data Engineer- Databricks Azure Data Factory Python

    3 days ago

    Kolkata, West Bengal, India timesjobs Full time

    Hiring For Data Engineer- Databricks Azure Data Factory Python Job Description Data Engineer- Databricks Azure Data Factory Python Desired Profile Skills: Azure Databricks Azure Data Factory Python, implementing both structured and unstructured data, Data migration solutions, Data Warehousing, Data processing / ETL / Big data, Hadoop, Java, Spark, Scala, and...

  • Hiring For Data Engineer- Databricks Azure Data Factory Python

    4 days ago

    Kolkata, India timesjobs Full time

    Hiring For Data Engineer- Databricks Azure Data Factory Python Job Description Data Engineer- Databricks Azure Data Factory Python Desired Profile Skills: Azure Databricks Azure Data Factory Python, implementing both structured and unstructured data, Data migration solutions, Data Warehousing, Data processing / ETL / Big data, Hadoop, Java, Spark,...

  • Azure Data Engineer

    6 days ago

    Kolkata, India LTIMindtree Full time

    Position: Azure Data EngineerLocation: Hyderabad / Chennai / Pune / Mumbai / Bangalore / KolkataExperience: 8 - 16 Years onlyMust have minimum of 6 Years of Database Experience with Azure cloud experienceMust have Data Mesh Data products implementation experienceMust have Data Governance Solution Experience Metadata Management Data Quality Lineage...

  • Azure Data Engineer

    5 days ago

    Kolkata, India LTIMindtree Full time

    Position: Azure Data EngineerLocation: Hyderabad / Chennai / Pune / Mumbai / Bangalore / KolkataExperience: 8 - 16 Years onlyMust have minimum of 6 Years of Database Experience with Azure cloud experienceMust have Data Mesh Data products implementation experienceMust have Data Governance Solution Experience Metadata Management Data Quality Lineage...

  • Data Engineer

    3 weeks ago

    Kolkata, West Bengal, India CA-One India Full time

    Job Title : Data : Kolkata, IndiaResponsibilities :- Design, build, and maintain scalable data pipelines.- Develop SparkSQL queries and BigQuery ML models.- Integrate Kafka for real-time data processing.- Manage BigQuery Data Transfer Service and Snowflake SQL queries.- Collaborate with cross-functional teams on data :- Bachelor's degree in Computer...

  • Data Engineer

    1 week ago

    kolkata, India CA-One India Full time

    Job Title : Data : Kolkata, India Responsibilities : - Design, build, and maintain scalable data pipelines.- Develop SparkSQL queries and BigQuery ML models.- Integrate Kafka for real-time data processing.- Manage BigQuery Data Transfer Service and Snowflake SQL queries.- Collaborate with cross-functional teams on data : - Bachelor's degree in Computer...

  • Data Engineer

    2 weeks ago

    Kolkata, India CA-One India Full time

    Job Title : Data : Kolkata, IndiaResponsibilities :- Design, build, and maintain scalable data pipelines.- Develop SparkSQL queries and BigQuery ML models.- Integrate Kafka for real-time data processing.- Manage BigQuery Data Transfer Service and Snowflake SQL queries.- Collaborate with cross-functional teams on data :- Bachelor's degree in Computer...

  • Data Engineer

    2 weeks ago

    Kolkata, India CA-One India Full time

    Job Title : Data : Kolkata, India Responsibilities : - Design, build, and maintain scalable data pipelines.- Develop SparkSQL queries and BigQuery ML models.- Integrate Kafka for real-time data processing.- Manage BigQuery Data Transfer Service and Snowflake SQL queries.- Collaborate with cross-functional teams on data : - Bachelor's degree in...

  • Data Engineer

    4 weeks ago

    kolkata, India Change leaders Full time

    Primary Skill : - GCP + Python + SQLOR- GCP + Java + SQLNP : Immediate to 35 Days maxJob Location : Mumbai / Pune / Chennai / Bangalore / Hyderabad / Kolkata / Noida- Bachelor's degree in computer science or a related discipline- 6+ years of applicable engineering experience- Experience in GCP, Big Query- Strong proficiency in Python with an emphasis in...

  • [3 Days Left] Senior Data Engineer

    5 days ago

    Kolkata, India FinArb Consulting Full time

    Responsibilities We are looking for a for a strong self-driven Senior Data Engineer to join the team of data and software ­­­engineeringPrimary responsibilities would include:Investigate source data systems to build comprehensive data models to serve as Single Source of Truth Design and implement flexible, robust & scalable ETL infrastructure Deploy...

  • Senior Data Engineer

    3 weeks ago

    Kolkata, India Nilasu consulting Full time

    Summary :- We are seeking a highly skilled and experienced Senior Data Engineer to join our team.- You will play a key role in designing, developing, and maintaining large-scale data processing pipelines using Python and Spark/PySpark.- Your expertise in distributed computing frameworks and DevOps tools will be instrumental in building efficient and scalable...

  • Senior Data Engineer

    3 weeks ago

    Greater Kolkata Area, India FinArb Consulting Full time

    ResponsibilitiesWe are looking for a for a strong self-driven Senior Data Engineer to join the team of data and software ­­­engineering Primary responsibilities would include:   Investigate source data systems to build comprehensive data models to serve as Single Source of TruthDesign and implement flexible, robust & scalable ETL infrastructureDeploy...

  • Data Engineer

    5 days ago

    kolkata, India Teksands.ai Full time

    Job Description : - 8+ years of analysis and reporting business intelligence-related needs.- Must have : Excellent Data warehousing, data modeling, and data transformation- Advanced SQL ,Tableau Reporting ,Design stable, reliable, and effective databases.- Interface with other technical personnel or team members to document, interpret, and finalize...