Data Engineer
4 weeks ago
About the Role :
We are seeking a skilled and experienced Big Data Engineer to join our team and play a crucial role in building and maintaining our big data infrastructure.
You will leverage your expertise in the Hadoop ecosystem and data processing frameworks to design, implement, and optimize scalable data pipelines.
Responsibilities :
- Design, develop, and maintain efficient data pipelines for large-scale data processing.
- Utilize your proficiency in HDFS, HiveQL, and PySpark to create and optimize data processing workflows.
- Perform data wrangling and transformation tasks to ensure data quality and consistency.
- Write efficient SQL queries for data manipulation and retrieval.
- Automate tasks and schedule jobs using Linux shell scripting.
- Develop and maintain Python scripts for data manipulation, analysis, and automation tasks.
- Collaborate with data analysts and data scientists to understand data needs and translate them into technical solutions.
- Troubleshoot and debug big data processing issues to ensure smooth system operation.
- Continuously monitor and optimize data pipelines for performance and scalability.
- Advocate for best practices in data management and big data technologies.
- Stay up-to-date on the latest trends and innovations in the big data and analytics landscape.
Qualifications :
- 4-8 years of experience as a Data Engineer or a similar role.
- Strong expertise in Hadoop ecosystem components, including HDFS, HiveQL, and YARN.
- Proven experience in developing and optimizing data processing workflows using PySpark.
- Proficiency in SQL for data manipulation and querying.
- Hands-on experience with Linux shell scripting for automation and job scheduling.
- Solid understanding of Python programming language and libraries for data manipulation and analysis.
- Experience with version control systems (Git) is a plus.
- Knowledge of CI/CD pipelines is a plus.
- Excellent communication and collaboration skills to work effectively with cross-functional teams.
- Strong problem-solving skills and a keen eye for detail.
- Proactive and eager to learn new technologies and stay updated in the big data field.
-
Big Data Engineer
2 months ago
Rajasthan/Karnataka/Metros/Jaipur/Udaipur/Bangalore/Raipur, IN ATech Full timeHiring For Big Data Engineer (Spark, Scala, AWS)Job description :- Spark, SCALA, AWS OR Spark, python with AWS lambda exposure.- Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements.- Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing...
-
Big Data Engineer
4 weeks ago
Rajasthan/Karnataka/Metros/Jaipur/Udaipur/Bangalore/Raipur, IN ATech Full timeHiring For Big Data Engineer (Spark, Scala, AWS)Job description :- Spark, SCALA, AWS OR Spark, python with AWS lambda exposure.- Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements.- Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing...
-
ETL Developer
2 months ago
Jaipur/Udaipur/Rajasthan/Karnataka/Bangalore/Mysore, IN ATech Full timeJob : ETL DeveloperSkills Required :- Experience in the database, data integration, and data migration- Good experience (3+ years) in development using databases such as Oracle, MS SQL Server, Teradata, etc.- Minimum of 2+ years of hands-on experience with Amazon Redshift.- Strong knowledge of the AWS environment and service knowledge with S3 storage...
-
ETL Developer
4 weeks ago
Jaipur/Udaipur/Rajasthan/Karnataka/Bangalore/Mysore, IN ATech Full timeJob : ETL DeveloperSkills Required :- Experience in the database, data integration, and data migration- Good experience (3+ years) in development using databases such as Oracle, MS SQL Server, Teradata, etc.- Minimum of 2+ years of hands-on experience with Amazon Redshift.- Strong knowledge of the AWS environment and service knowledge with S3 storage...
-
Data Analyst
2 months ago
Anywhere in India/Multiple Locations/Bangalore/Mysore/Karnataka, IN Aricent Full timePosition : DATA AnalystType : WFO/ WFHJob Role and Description :- Using automated tools to extract data from primary and secondary sources- Proficiency in fine-tuning data queries. - Strong SQL skills and knowledge of SQL queries/SQL Server Integration Services (SSIS) are required- Familiarity with Dimensional Modeling design principles is a plus. -...
-
Senior Data Scientist
2 months ago
Karnataka/Rajasthan/Gujarat/Bangalore/Jaipur/Udaipur/Ahmedabad/Gandhinagar/Vadodara/Baroda/Surat/Nas, IN ATech Full timeJob Profile : Senior Data ScientistJob description- We are seeking a highly skilled and collaborative Senior Data Scientist to join our team- Reporting to the Director of Data Science, you will work alongside and provide technical guidance to a subset of our Analytics and Insights group and provide support to a few business lines including Industry and...
-
Artificial Intelligence Engineer
2 months ago
Karnataka/Bangalore/Maharashtra/Mumbai/Navi Mumbai/Pune/Mysore/Aurangabad/Nagpur/Nasik, IN Aricent Full timeJob Roles : AI Software EngineerJob Description :We are on the lookout for a passionate Artificial Intelligence Engineer to be a part of our dynamic team. In this role, your curiosity and deep interest in AI, machine learning, and keeping pace with a rapidly evolving field will guide your path. You will delve into extensive data sets, identify patterns, and...
-
Artificial Intelligence Engineer
4 weeks ago
Karnataka/Bangalore/Maharashtra/Mumbai/Navi Mumbai/Pune/Mysore/Aurangabad/Nagpur/Nasik, IN Aricent Full timeJob Roles : AI Software EngineerJob Description :We are on the lookout for a passionate Artificial Intelligence Engineer to be a part of our dynamic team. In this role, your curiosity and deep interest in AI, machine learning, and keeping pace with a rapidly evolving field will guide your path. You will delve into extensive data sets, identify patterns, and...
-
Generative AI Engineer
2 months ago
Anywhere in India/Multiple Locations/Bangalore/Karnataka/Kerala/Tamil Nadu, IN Veritas Resource Management Full timeWe are looking for Generative AI EngineerExp : 5+ Years, Location: Remote.Experience: 5+ years' experience with AI/ML (2+ years in Gen AI) Qualifications : - Bachelor's degree in Computer Science, Engineering, Mathematics, or related field; Master's or Ph.D. - Proficiency in programming languages such as Python (preferred) or R, - Strong...
-
Generative AI Engineer
4 weeks ago
Anywhere in India/Multiple Locations/Bangalore/Karnataka/Kerala/Tamil Nadu, IN Veritas Resource Management Full timeWe are looking for Generative AI EngineerExp : 5+ Years, Location: Remote.Experience: 5+ years' experience with AI/ML (2+ years in Gen AI) Qualifications : - Bachelor's degree in Computer Science, Engineering, Mathematics, or related field; Master's or Ph.D. - Proficiency in programming languages such as Python (preferred) or R, - Strong...
-
Software Development Engineer
4 weeks ago
Bangalore/Rajasthan/Jaipur/Karnataka/Udaipur/Mysore/Kolkata/Vishakhapatnam/Vizag/Qatar/Oman/Dubai, IN ATech Full timeJob Role : Software Development Engineer Test (SDET)Job Description :What You'll Do :- Develop automated test scripts using ROBOT framework (Python) or similar frameworks, focusing on keyword-driven and data-driven testing.- Create test plans and cases with TestRail and test management tools and Jira for agile project tracking.- Analyze tests using CI/CD...
-
Software Development Engineer
4 weeks ago
Bangalore/Rajasthan/Jaipur/Karnataka/Udaipur/Mysore/Kolkata/Vishakhapatnam/Vizag/Qatar/Oman/Dubai, IN ATech Full timeJob Role : Software Development Engineer Test (SDET)Job Description :What You'll Do :- Develop automated test scripts using ROBOT framework (Python) or similar frameworks, focusing on keyword-driven and data-driven testing.- Create test plans and cases with TestRail and test management tools and Jira for agile project tracking.- Analyze tests using CI/CD...
-
Azure DevOps Engineer
2 months ago
Bhopal/MP/Jammu & Kashmir/Karnataka/Bangalore/Pune/Mumbai/Navi Mumbai/Maharashtra/Nagpur/Nasik/Anywh, IN Aricent Full timeProfile : Azure Devops EngineerOpen to work in WFO or WFH modeJob Description :- Build enterprise curate - Experience in CI/CD pipelines from scratch- Experience with bug tracking and task management software such as JIRA, etc.- Experienced in managing outages, customer escalations, crisis management, and other similar circumstances.- Experience with CI/CD...
-
Azure DevOps Engineer
4 weeks ago
Bhopal/MP/Jammu & Kashmir/Karnataka/Bangalore/Pune/Mumbai/Navi Mumbai/Maharashtra/Nagpur/Nasik/Anywh, IN Aricent Full timeProfile : Azure Devops EngineerOpen to work in WFO or WFH modeJob Description :- Build enterprise curate - Experience in CI/CD pipelines from scratch- Experience with bug tracking and task management software such as JIRA, etc.- Experienced in managing outages, customer escalations, crisis management, and other similar circumstances.- Experience with CI/CD...
-
Aezion - Lead SQL Developer
2 months ago
Bangalore/Coimbatore/Mysore/Tamil Nadu/Karnataka, IN Aezion.Inc Full timeRole : Lead SQL DeveloperLocation : timeResponsibilities :- Develop stored procedures, functions, packages, triggers, views, CTEs using T-SQL.- Design logical and physical data models along with collaring, preparing, and presenting statistical information for both internal and external use.- Ensure database optimization, integrity, consistency, security, and...
-
Aezion - Lead SQL Developer
4 weeks ago
Bangalore/Coimbatore/Mysore/Tamil Nadu/Karnataka, IN Aezion.Inc Full timeRole : Lead SQL DeveloperLocation : timeResponsibilities :- Develop stored procedures, functions, packages, triggers, views, CTEs using T-SQL.- Design logical and physical data models along with collaring, preparing, and presenting statistical information for both internal and external use.- Ensure database optimization, integrity, consistency, security, and...
-
Oracle Database Administrator
2 months ago
Anywhere in India/Multiple Locations/Tamil Nadu/Karnataka/Maharashtra, IN Aricent Full timeRole : Oracle Database AdministratorSite : WFO/WFHIndustry Type : IT Services & ConsultingDepartment : Engineering - SoftwareEmployment Type : Full Time, PermanentRole Category : DBA Database Administrator Responsibilities :Oracle Database Architecture :- Installation, configuration, and upgrading of Oracle server in a standalone or RAC Environment-...
-
Oracle Database Administrator
4 weeks ago
Anywhere in India/Multiple Locations/Tamil Nadu/Karnataka/Maharashtra, IN Aricent Full timeRole : Oracle Database AdministratorSite : WFO/WFHIndustry Type : IT Services & ConsultingDepartment : Engineering - SoftwareEmployment Type : Full Time, PermanentRole Category : DBA Database Administrator Responsibilities :Oracle Database Architecture :- Installation, configuration, and upgrading of Oracle server in a standalone or RAC Environment-...
-
Data Engineer
1 month ago
Karnataka/Bangarapet, India RiskInsight Consulting Pvt Ltd Full timeAbout the Role :We are seeking a skilled and experienced Big Data Engineer to join our team and play a crucial role in building and maintaining our big data infrastructure. You will leverage your expertise in the Hadoop ecosystem and data processing frameworks to design, implement, and optimize scalable data pipelines.Responsibilities : - Design, develop,...
-
Data Engineer
3 weeks ago
Karnataka/Bangarapet, India RiskInsight Consulting Pvt Ltd Full timeAbout the Role :We are seeking a skilled and experienced Big Data Engineer to join our team and play a crucial role in building and maintaining our big data infrastructure. You will leverage your expertise in the Hadoop ecosystem and data processing frameworks to design, implement, and optimize scalable data pipelines.Responsibilities : - Design, develop,...
-
Networking Advisor
2 weeks ago
Bangarapet, India NTT DATA Full time**Req ID**:223622 We are currently seeking a Networking Advisor to join our team in Delhi, Uttar Pradesh (IN-UP), India (IN). **Position overview** The position requires, day to day operational support for requests and incidents on all network related aspects involving multiple technologies such as: wireless, switching, routing, sdwan, and high level...
-
Data Engineer
1 month ago
Bangarapet, India RiskInsight Consulting Pvt Ltd Full timeAbout the Role :We are seeking a skilled and experienced Big Data Engineer to join our team and play a crucial role in building and maintaining our big data infrastructure. You will leverage your expertise in the Hadoop ecosystem and data processing frameworks to design, implement, and optimize scalable data pipelines.Responsibilities : - Design, develop,...
-
Data Engineer
3 weeks ago
Bangarapet, India RiskInsight Consulting Pvt Ltd Full timeAbout the Role :We are seeking a skilled and experienced Big Data Engineer to join our team and play a crucial role in building and maintaining our big data infrastructure. You will leverage your expertise in the Hadoop ecosystem and data processing frameworks to design, implement, and optimize scalable data pipelines.Responsibilities : - Design, develop,...
-
Senior DevOps Engineer
1 month ago
Bangarapet, India Skan Full timeResponsibilities & Deliverables: Guide the design and development of reusable Infrastructure as Code (IaC) components; create IaC test plans and execute testing across the lifecycle Deploy and support Cloud resources IaaS, PaaS, and/or SaaS, using infrastructure as code via CICD pipeline, K8 using Helm. Write automation scripts for building, deploying...
-
Data Enginer
2 months ago
Bengaluru, Karnataka, India NatWest Group Full timeOur people work differently depending on their jobs and needs. From hybrid working to flexible hours, we have plenty of options that help our people to thrive. This role is based in India and as such all normal working days must be carried out in India. Join us as a Data Engineer - This is an exciting opportunity to use your technical expertise to...
-
Data Engineer
4 weeks ago
Karnataka, India Synechron Technologies Pvt. Ltd. Full timeEducationDegree, Postgraduate in Computer Science or related field (or equivalent industry experience)ExperienceMinimum 5+ years of development and design experience in Java/Scala/Python with Flink, Beam (or Spark Streaming using Real Time data and not batch data) and Kafka.Technical Skills• Containerization and orchestration (Docker and...
-
Data Engineer
4 weeks ago
karnataka, India Synechron Technologies Pvt. Ltd. Full timeEducation Degree, Postgraduate in Computer Science or related field (or equivalent industry experience) Experience Minimum 5+ years of development and design experience in Java/Scala/Python with Flink, Beam (or Spark Streaming using Real Time data and not batch data) and Kafka. Technical Skills • Containerization and orchestration (Docker and...
-
Data Engineer
4 weeks ago
Karnataka, India Synechron Technologies Pvt. Ltd. Full timeEducationDegree, Postgraduate in Computer Science or related field (or equivalent industry experience)ExperienceMinimum 5+ years of development and design experience in Java/Scala/Python with Flink, Beam (or Spark Streaming using Real Time data and not batch data) and Kafka.Technical Skills• Containerization and orchestration (Docker and...
-
Data Engineer
3 weeks ago
Karnataka, India Synechron Technologies Pvt. Ltd. Full timeEducation Degree, Postgraduate in Computer Science or related field (or equivalent industry experience) Experience Minimum 5+ years of development and design experience in Java/Scala/Python with Flink, Beam (or Spark Streaming using Real Time data and not batch data) and Kafka. Technical Skills • Containerization and orchestration (Docker and...
-
Engineer, Data
4 weeks ago
Karnataka, 560064, Bangalore, India Giant Eagle GCC Full timeJob SummaryAs a Data Engineer on the Customer Loyalty & Experience team, you will be working on a team to bring customer-centric personalization to life. In this role, you will be empowered to develop data solutions in support of marketing analytics and data science by engaging with project managers, technology teams, analysts, and business partners to...
-
Engineer, Data
4 weeks ago
, Karnataka, India Giant Eagle GCC Full timeJob SummaryAs a Data Engineer on the Customer Loyalty & Experience team, you will be working on a team to bring customer-centric personalization to life. In this role, you will be empowered to develop data solutions in support of marketing analytics and data science by engaging with project managers, technology teams, analysts, and business partners to...
-
Azure Data Engineer
2 weeks ago
Bengaluru, Karnataka, India DigitalCube Consultancy Full time**Azure Data Engineer** **Job Type - Full time** **Location - Bangalore/ Mumbai, India** **Responsibilities**: - Design, develop, and maintain scalable data pipelines using Azure Data Factory, Azure Databricks, and other Azure data services. - Utilize Databricks for big data analytics and real-time data processing, ensuring optimal performance and...
-
Infor Mfg, Qty, Engg Testing
4 days ago
Bengaluru, Karnataka, India NTT DATA Full timeShift Timings: 1:00 PM IST to 11:00 PM IST Job Responsibilities: - Understand customizations to standard related to modules Mfg, Quality and Engineering - Understand integrations of other modules with Mfg, Quality and Engineering - Understand MES business process and integration with ERP LN - Write Functional, Regression and End to End Test Cases - Prepare...
-
Engineer Sr., Data
1 month ago
Karnataka, 560064, Bangalore, India Giant Eagle GCC Full timeJob SummaryYou will be working on a team to bring customer-centric personalization to life. In this role, you will be empowered to develop data solutions in support of customer facing applications as well as analytics for internal teams and business. This leading technical and architecture role will collaborate with product managers, architects, technology...
-
Engineer Sr., Data
1 month ago
, Karnataka, India Giant Eagle GCC Full timeJob SummaryYou will be working on a team to bring customer-centric personalization to life. In this role, you will be empowered to develop data solutions in support of customer facing applications as well as analytics for internal teams and business. This leading technical and architecture role will collaborate with product managers, architects, technology...
-
Engineer Sr., Data
3 weeks ago
, Karnataka, India Giant Eagle GCC Full timeJob SummaryYou will be working on a team to bring customer-centric personalization to life. In this role, you will be empowered to develop data solutions in support of customer facing applications as well as analytics for internal teams and business. This leading technical and architecture role will collaborate with product managers, architects, technology...
-
Engineer Sr., Data
4 weeks ago
Karnataka, 560064, Bangalore, India Giant Eagle GCC Full timeJob SummaryYou will be working on a team to bring customer-centric personalization to life. In this role, you will be empowered to develop data solutions in support of customer facing applications as well as analytics for internal teams and business. This leading technical and architecture role will collaborate with product managers, architects, technology...
-
Sdk Resource
1 week ago
Bengaluru, Karnataka, India NTT DATA Full time**Req ID**: 280859 We are currently seeking a SDK Resource to join our team in BENGALURU, Karnātaka (IN-KA), India (IN). **Roles & Responsibilities**: Responsible for programming and software development using various programming languages and related tools and frameworks, reviewing code written by other programmers, requirement gathering, bug fixing,...