Data Engineer
4 weeks ago
Job description :
We seek a talented Data Engineer with expertise in Robotic Process Automation (RPA) and Artificial Intelligence/Machine Learning (AI/ML) to join our dynamic team.
As a Data Engineer with RPA and AI/ML expertise, you will play a crucial role in designing, implementing, and maintaining data pipelines, workflows, and automation solutions.
You will be responsible for developing and fine-tuning LLM models with expertise in RAG (Retrieval-Augmented Generation), content extraction, and familiarity with the concept of local LLMs.
You will work closely with our Data Engineering team to innovate and optimize LLM models and collaborate closely with cross-functional teams to integrate RPA infrastructure, enabling clients to automate existing processes.
Role & responsibilities :
- Develop and optimize LLM models using state-of-the-art techniques, focusing on RAG (Retrieval-Augmented Generation).
- Implement content extraction methods to enhance the accuracy and relevance of generated responses.
- Collaborate with cross-functional teams to identify and address LLM development and deployment challenges.
- Stay updated with the latest advancements in natural language processing (NLP) and machine learning research.
- Provide technical guidance and mentorship to junior team members.
- Contribute to documenting and disseminating best practices in LLM development and deployment.
- Implement RPA solutions to automate repetitive tasks and improve operational efficiency
- Collaborate with data scientists and business analysts to understand data requirements and translate them into technical solutions.
- Monitor performance, troubleshoot issues, and optimize data workflows for scalability and reliability
- Stay up-to-date with the latest trends and technologies in data engineering, RPA, and AI/ML
Required Skill Sets :
- Bachelor's or higher degree in Computer Science, Engineering, or a related field.
- Proven experience in developing and fine-tuning LLM models, preferably with a focus on RAG.
- Hands-on experience with RPA tools such as UiPath, Automation Anywhere, Blue Prism, Power Automate
- Strong proficiency in Python programming and familiarity with relevant libraries/frameworks such as TensorFlow, PyTorch, scikit-learn.
- Solid understanding of natural language processing (NLP) fundamentals and machine learning principles.
- Experience with content extraction techniques such as Named Entity Recognition (NER), text summarization, and information retrieval.
- Familiarity with the concept of local LLMs and their applications in specific domains or languages.
- Excellent problem-solving skills and the ability to work effectively in a collaborative team environment.
- Strong communication skills with the ability to explain complex technical concepts to non-technical stakeholders.
Preferred Qualifications :
- Experience with cloud platforms such as AWS, Azure, or Google Cloud
- Prior working knowledge in implementing RPA and AI/ ML Methods.
- Certification in RPA or AI/ML technologies.
- Contributions to open-source projects related to natural language processing or machine learning.
- Knowledge of big data technologies (e.g., Hadoop, Spark, Kafka)
-
Specialist Data center operations
4 weeks ago
Kolkata, India NTT DATA Full timeThe role of Critical Facilities Maintenance Engineer is responsible for working with all major systems within a facility or building such as electrical and HVAC systems and performs regular maintenance on all systems. This position performs hands-on operations and maintenance which includes all physical and administrative operations tasks, service, and...
-
Specialist Data center operations
4 weeks ago
Kolkata, India NTT DATA Full timeThe role of Critical Facilities Maintenance Engineer is responsible for working with all major systems within a facility or building such as electrical and HVAC systems and performs regular maintenance on all systems. This position performs hands-on operations and maintenance which includes all physical and administrative operations tasks, service, and...
-
Data Engineer
1 day ago
kolkata, India HTD Resources Full timeSkill: Data Engineer with Python knowledge Designation : Software Engineer Relevant Experience: 5 - 6 years Mandatory Skills: Primary Skills - Python, SQL, AWS, DWH Concept, ELT, Secondary Skills - GCP, CDC Location: Mumbai / Kolkata Mode: Work from Office Interview Rounds: 3-4 Rounds
-
Software Engineer-Data Engineer
3 weeks ago
Kolkata, India CliniSys Full timeEssential FunctionsExtract data from on-prem databases using appropriate tools and techniques.Transform and clean the data to ensure its suitability for PowerBI analysis.Build and maintain data pipelines for regular data refresh in PowerBI.Monitor and maintain Azure Synapse pipelines for on-prem data extraction and transformation.Collaborate with analysts to...
-
Senior Data Engineer
3 weeks ago
Kolkata, India FinArb Consulting Full timeResponsibilitiesWe are looking for a for a strong self-driven Senior Data Engineer to join the team of data and software engineeringPrimary responsibilities would include:Investigate source data systems to build comprehensive data models to serve as Single Source of TruthDesign and implement flexible, robust & scalable ETL infrastructureDeploy...
-
Senior Data Engineer
3 weeks ago
Kolkata, India FinArb Consulting Full timeResponsibilitiesWe are looking for a for a strong self-driven Senior Data Engineer to join the team of data and software engineering Primary responsibilities would include: Investigate source data systems to build comprehensive data models to serve as Single Source of TruthDesign and implement flexible, robust & scalable ETL infrastructureDeploy...
-
Senior Data Engineer
3 weeks ago
kolkata, India FinArb Consulting Full timeResponsibilities We are looking for a for a strong self-driven Senior Data Engineer to join the team of data and software engineering Primary responsibilities would include: Investigate source data systems to build comprehensive data models to serve as Single Source of Truth Design and implement flexible, robust & scalable ETL...
-
Kolkata, West Bengal, India timesjobs Full timeHiring For Data Engineer- Databricks Azure Data Factory Python Job Description Data Engineer- Databricks Azure Data Factory Python Desired Profile Skills: Azure Databricks Azure Data Factory Python, implementing both structured and unstructured data, Data migration solutions, Data Warehousing, Data processing / ETL / Big data, Hadoop, Java, Spark, Scala, and...
-
Kolkata, India timesjobs Full timeHiring For Data Engineer- Databricks Azure Data Factory Python Job Description Data Engineer- Databricks Azure Data Factory Python Desired Profile Skills: Azure Databricks Azure Data Factory Python, implementing both structured and unstructured data, Data migration solutions, Data Warehousing, Data processing / ETL / Big data, Hadoop, Java, Spark,...
-
Azure Data Engineer
6 days ago
Kolkata, India LTIMindtree Full timePosition: Azure Data EngineerLocation: Hyderabad / Chennai / Pune / Mumbai / Bangalore / KolkataExperience: 8 - 16 Years onlyMust have minimum of 6 Years of Database Experience with Azure cloud experienceMust have Data Mesh Data products implementation experienceMust have Data Governance Solution Experience Metadata Management Data Quality Lineage...
-
Azure Data Engineer
5 days ago
Kolkata, India LTIMindtree Full timePosition: Azure Data EngineerLocation: Hyderabad / Chennai / Pune / Mumbai / Bangalore / KolkataExperience: 8 - 16 Years onlyMust have minimum of 6 Years of Database Experience with Azure cloud experienceMust have Data Mesh Data products implementation experienceMust have Data Governance Solution Experience Metadata Management Data Quality Lineage...
-
Data Engineer
3 weeks ago
Kolkata, West Bengal, India CA-One India Full timeJob Title : Data : Kolkata, IndiaResponsibilities :- Design, build, and maintain scalable data pipelines.- Develop SparkSQL queries and BigQuery ML models.- Integrate Kafka for real-time data processing.- Manage BigQuery Data Transfer Service and Snowflake SQL queries.- Collaborate with cross-functional teams on data :- Bachelor's degree in Computer...
-
Data Engineer
1 week ago
kolkata, India CA-One India Full timeJob Title : Data : Kolkata, India Responsibilities : - Design, build, and maintain scalable data pipelines.- Develop SparkSQL queries and BigQuery ML models.- Integrate Kafka for real-time data processing.- Manage BigQuery Data Transfer Service and Snowflake SQL queries.- Collaborate with cross-functional teams on data : - Bachelor's degree in Computer...
-
Data Engineer
2 weeks ago
Kolkata, India CA-One India Full timeJob Title : Data : Kolkata, IndiaResponsibilities :- Design, build, and maintain scalable data pipelines.- Develop SparkSQL queries and BigQuery ML models.- Integrate Kafka for real-time data processing.- Manage BigQuery Data Transfer Service and Snowflake SQL queries.- Collaborate with cross-functional teams on data :- Bachelor's degree in Computer...
-
Data Engineer
2 weeks ago
Kolkata, India CA-One India Full timeJob Title : Data : Kolkata, India Responsibilities : - Design, build, and maintain scalable data pipelines.- Develop SparkSQL queries and BigQuery ML models.- Integrate Kafka for real-time data processing.- Manage BigQuery Data Transfer Service and Snowflake SQL queries.- Collaborate with cross-functional teams on data : - Bachelor's degree in...
-
Data Engineer
4 weeks ago
kolkata, India Change leaders Full timePrimary Skill : - GCP + Python + SQLOR- GCP + Java + SQLNP : Immediate to 35 Days maxJob Location : Mumbai / Pune / Chennai / Bangalore / Hyderabad / Kolkata / Noida- Bachelor's degree in computer science or a related discipline- 6+ years of applicable engineering experience- Experience in GCP, Big Query- Strong proficiency in Python with an emphasis in...
-
[3 Days Left] Senior Data Engineer
5 days ago
Kolkata, India FinArb Consulting Full timeResponsibilities We are looking for a for a strong self-driven Senior Data Engineer to join the team of data and software engineeringPrimary responsibilities would include:Investigate source data systems to build comprehensive data models to serve as Single Source of Truth Design and implement flexible, robust & scalable ETL infrastructure Deploy...
-
Senior Data Engineer
3 weeks ago
Kolkata, India Nilasu consulting Full timeSummary :- We are seeking a highly skilled and experienced Senior Data Engineer to join our team.- You will play a key role in designing, developing, and maintaining large-scale data processing pipelines using Python and Spark/PySpark.- Your expertise in distributed computing frameworks and DevOps tools will be instrumental in building efficient and scalable...
-
Senior Data Engineer
3 weeks ago
Greater Kolkata Area, India FinArb Consulting Full timeResponsibilitiesWe are looking for a for a strong self-driven Senior Data Engineer to join the team of data and software engineering Primary responsibilities would include: Investigate source data systems to build comprehensive data models to serve as Single Source of TruthDesign and implement flexible, robust & scalable ETL infrastructureDeploy...
-
Data Engineer
5 days ago
kolkata, India Teksands.ai Full timeJob Description : - 8+ years of analysis and reporting business intelligence-related needs.- Must have : Excellent Data warehousing, data modeling, and data transformation- Advanced SQL ,Tableau Reporting ,Design stable, reliable, and effective databases.- Interface with other technical personnel or team members to document, interpret, and finalize...