Data Engineer

4 weeks ago


KarnatakaBangarapet, IN RiskInsight Consulting Pvt Ltd Full time

About the Role :

We are seeking a skilled and experienced Big Data Engineer to join our team and play a crucial role in building and maintaining our big data infrastructure.

You will leverage your expertise in the Hadoop ecosystem and data processing frameworks to design, implement, and optimize scalable data pipelines.

Responsibilities :

- Design, develop, and maintain efficient data pipelines for large-scale data processing.

- Utilize your proficiency in HDFS, HiveQL, and PySpark to create and optimize data processing workflows.

- Perform data wrangling and transformation tasks to ensure data quality and consistency.

- Write efficient SQL queries for data manipulation and retrieval.

- Automate tasks and schedule jobs using Linux shell scripting.

- Develop and maintain Python scripts for data manipulation, analysis, and automation tasks.

- Collaborate with data analysts and data scientists to understand data needs and translate them into technical solutions.

- Troubleshoot and debug big data processing issues to ensure smooth system operation.

- Continuously monitor and optimize data pipelines for performance and scalability.

- Advocate for best practices in data management and big data technologies.

- Stay up-to-date on the latest trends and innovations in the big data and analytics landscape.

Qualifications :

- 4-8 years of experience as a Data Engineer or a similar role.

- Strong expertise in Hadoop ecosystem components, including HDFS, HiveQL, and YARN.

- Proven experience in developing and optimizing data processing workflows using PySpark.

- Proficiency in SQL for data manipulation and querying.

- Hands-on experience with Linux shell scripting for automation and job scheduling.

- Solid understanding of Python programming language and libraries for data manipulation and analysis.

- Experience with version control systems (Git) is a plus.

- Knowledge of CI/CD pipelines is a plus.

- Excellent communication and collaboration skills to work effectively with cross-functional teams.

- Strong problem-solving skills and a keen eye for detail.

- Proactive and eager to learn new technologies and stay updated in the big data field.

(ref:hirist.tech)
  • Big Data Engineer

    2 months ago


    Rajasthan/Karnataka/Metros/Jaipur/Udaipur/Bangalore/Raipur, IN ATech Full time

    Hiring For Big Data Engineer (Spark, Scala, AWS)Job description :- Spark, SCALA, AWS OR Spark, python with AWS lambda exposure.- Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements.- Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing...

  • Big Data Engineer

    4 weeks ago


    Rajasthan/Karnataka/Metros/Jaipur/Udaipur/Bangalore/Raipur, IN ATech Full time

    Hiring For Big Data Engineer (Spark, Scala, AWS)Job description :- Spark, SCALA, AWS OR Spark, python with AWS lambda exposure.- Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements.- Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing...

  • ETL Developer

    2 months ago


    Jaipur/Udaipur/Rajasthan/Karnataka/Bangalore/Mysore, IN ATech Full time

    Job : ETL DeveloperSkills Required :- Experience in the database, data integration, and data migration- Good experience (3+ years) in development using databases such as Oracle, MS SQL Server, Teradata, etc.- Minimum of 2+ years of hands-on experience with Amazon Redshift.- Strong knowledge of the AWS environment and service knowledge with S3 storage...

  • ETL Developer

    4 weeks ago


    Jaipur/Udaipur/Rajasthan/Karnataka/Bangalore/Mysore, IN ATech Full time

    Job : ETL DeveloperSkills Required :- Experience in the database, data integration, and data migration- Good experience (3+ years) in development using databases such as Oracle, MS SQL Server, Teradata, etc.- Minimum of 2+ years of hands-on experience with Amazon Redshift.- Strong knowledge of the AWS environment and service knowledge with S3 storage...

  • Data Analyst

    2 months ago


    Anywhere in India/Multiple Locations/Bangalore/Mysore/Karnataka, IN Aricent Full time

    Position : DATA AnalystType : WFO/ WFHJob Role and Description :- Using automated tools to extract data from primary and secondary sources- Proficiency in fine-tuning data queries. - Strong SQL skills and knowledge of SQL queries/SQL Server Integration Services (SSIS) are required- Familiarity with Dimensional Modeling design principles is a plus. -...

  • Senior Data Scientist

    2 months ago


    Karnataka/Rajasthan/Gujarat/Bangalore/Jaipur/Udaipur/Ahmedabad/Gandhinagar/Vadodara/Baroda/Surat/Nas, IN ATech Full time

    Job Profile : Senior Data ScientistJob description- We are seeking a highly skilled and collaborative Senior Data Scientist to join our team- Reporting to the Director of Data Science, you will work alongside and provide technical guidance to a subset of our Analytics and Insights group and provide support to a few business lines including Industry and...


  • Karnataka/Bangalore/Maharashtra/Mumbai/Navi Mumbai/Pune/Mysore/Aurangabad/Nagpur/Nasik, IN Aricent Full time

    Job Roles : AI Software EngineerJob Description :We are on the lookout for a passionate Artificial Intelligence Engineer to be a part of our dynamic team. In this role, your curiosity and deep interest in AI, machine learning, and keeping pace with a rapidly evolving field will guide your path. You will delve into extensive data sets, identify patterns, and...


  • Karnataka/Bangalore/Maharashtra/Mumbai/Navi Mumbai/Pune/Mysore/Aurangabad/Nagpur/Nasik, IN Aricent Full time

    Job Roles : AI Software EngineerJob Description :We are on the lookout for a passionate Artificial Intelligence Engineer to be a part of our dynamic team. In this role, your curiosity and deep interest in AI, machine learning, and keeping pace with a rapidly evolving field will guide your path. You will delve into extensive data sets, identify patterns, and...

  • Generative AI Engineer

    2 months ago


    Anywhere in India/Multiple Locations/Bangalore/Karnataka/Kerala/Tamil Nadu, IN Veritas Resource Management Full time

    We are looking for Generative AI EngineerExp : 5+ Years, Location: Remote.Experience: 5+ years' experience with AI/ML (2+ years in Gen AI) Qualifications : - Bachelor's degree in Computer Science, Engineering, Mathematics, or related field; Master's or Ph.D. - Proficiency in programming languages such as Python (preferred) or R, - Strong...


  • Anywhere in India/Multiple Locations/Bangalore/Karnataka/Kerala/Tamil Nadu, IN Veritas Resource Management Full time

    We are looking for Generative AI EngineerExp : 5+ Years, Location: Remote.Experience: 5+ years' experience with AI/ML (2+ years in Gen AI) Qualifications : - Bachelor's degree in Computer Science, Engineering, Mathematics, or related field; Master's or Ph.D. - Proficiency in programming languages such as Python (preferred) or R, - Strong...


  • Bangalore/Rajasthan/Jaipur/Karnataka/Udaipur/Mysore/Kolkata/Vishakhapatnam/Vizag/Qatar/Oman/Dubai, IN ATech Full time

    Job Role : Software Development Engineer Test (SDET)Job Description :What You'll Do :- Develop automated test scripts using ROBOT framework (Python) or similar frameworks, focusing on keyword-driven and data-driven testing.- Create test plans and cases with TestRail and test management tools and Jira for agile project tracking.- Analyze tests using CI/CD...


  • Bangalore/Rajasthan/Jaipur/Karnataka/Udaipur/Mysore/Kolkata/Vishakhapatnam/Vizag/Qatar/Oman/Dubai, IN ATech Full time

    Job Role : Software Development Engineer Test (SDET)Job Description :What You'll Do :- Develop automated test scripts using ROBOT framework (Python) or similar frameworks, focusing on keyword-driven and data-driven testing.- Create test plans and cases with TestRail and test management tools and Jira for agile project tracking.- Analyze tests using CI/CD...

  • Azure DevOps Engineer

    2 months ago


    Bhopal/MP/Jammu & Kashmir/Karnataka/Bangalore/Pune/Mumbai/Navi Mumbai/Maharashtra/Nagpur/Nasik/Anywh, IN Aricent Full time

    Profile : Azure Devops EngineerOpen to work in WFO or WFH modeJob Description :- Build enterprise curate - Experience in CI/CD pipelines from scratch- Experience with bug tracking and task management software such as JIRA, etc.- Experienced in managing outages, customer escalations, crisis management, and other similar circumstances.- Experience with CI/CD...

  • Azure DevOps Engineer

    4 weeks ago


    Bhopal/MP/Jammu & Kashmir/Karnataka/Bangalore/Pune/Mumbai/Navi Mumbai/Maharashtra/Nagpur/Nasik/Anywh, IN Aricent Full time

    Profile : Azure Devops EngineerOpen to work in WFO or WFH modeJob Description :- Build enterprise curate - Experience in CI/CD pipelines from scratch- Experience with bug tracking and task management software such as JIRA, etc.- Experienced in managing outages, customer escalations, crisis management, and other similar circumstances.- Experience with CI/CD...


  • Bangalore/Coimbatore/Mysore/Tamil Nadu/Karnataka, IN Aezion.Inc Full time

    Role : Lead SQL DeveloperLocation : timeResponsibilities :- Develop stored procedures, functions, packages, triggers, views, CTEs using T-SQL.- Design logical and physical data models along with collaring, preparing, and presenting statistical information for both internal and external use.- Ensure database optimization, integrity, consistency, security, and...


  • Bangalore/Coimbatore/Mysore/Tamil Nadu/Karnataka, IN Aezion.Inc Full time

    Role : Lead SQL DeveloperLocation : timeResponsibilities :- Develop stored procedures, functions, packages, triggers, views, CTEs using T-SQL.- Design logical and physical data models along with collaring, preparing, and presenting statistical information for both internal and external use.- Ensure database optimization, integrity, consistency, security, and...


  • Anywhere in India/Multiple Locations/Tamil Nadu/Karnataka/Maharashtra, IN Aricent Full time

    Role : Oracle Database AdministratorSite : WFO/WFHIndustry Type : IT Services & ConsultingDepartment : Engineering - SoftwareEmployment Type : Full Time, PermanentRole Category : DBA Database Administrator Responsibilities :Oracle Database Architecture :- Installation, configuration, and upgrading of Oracle server in a standalone or RAC Environment-...


  • Anywhere in India/Multiple Locations/Tamil Nadu/Karnataka/Maharashtra, IN Aricent Full time

    Role : Oracle Database AdministratorSite : WFO/WFHIndustry Type : IT Services & ConsultingDepartment : Engineering - SoftwareEmployment Type : Full Time, PermanentRole Category : DBA Database Administrator Responsibilities :Oracle Database Architecture :- Installation, configuration, and upgrading of Oracle server in a standalone or RAC Environment-...

  • Data Engineer

    1 month ago


    Karnataka/Bangarapet, India RiskInsight Consulting Pvt Ltd Full time

    About the Role :We are seeking a skilled and experienced Big Data Engineer to join our team and play a crucial role in building and maintaining our big data infrastructure. You will leverage your expertise in the Hadoop ecosystem and data processing frameworks to design, implement, and optimize scalable data pipelines.Responsibilities : - Design, develop,...

  • Data Engineer

    3 weeks ago


    Karnataka/Bangarapet, India RiskInsight Consulting Pvt Ltd Full time

    About the Role :We are seeking a skilled and experienced Big Data Engineer to join our team and play a crucial role in building and maintaining our big data infrastructure. You will leverage your expertise in the Hadoop ecosystem and data processing frameworks to design, implement, and optimize scalable data pipelines.Responsibilities : - Design, develop,...

  • Networking Advisor

    2 weeks ago


    Bangarapet, India NTT DATA Full time

    **Req ID**:223622 We are currently seeking a Networking Advisor to join our team in Delhi, Uttar Pradesh (IN-UP), India (IN). **Position overview** The position requires, day to day operational support for requests and incidents on all network related aspects involving multiple technologies such as: wireless, switching, routing, sdwan, and high level...

  • Data Engineer

    1 month ago


    Bangarapet, India RiskInsight Consulting Pvt Ltd Full time

    About the Role :We are seeking a skilled and experienced Big Data Engineer to join our team and play a crucial role in building and maintaining our big data infrastructure. You will leverage your expertise in the Hadoop ecosystem and data processing frameworks to design, implement, and optimize scalable data pipelines.Responsibilities : - Design, develop,...

  • Data Engineer

    3 weeks ago


    Bangarapet, India RiskInsight Consulting Pvt Ltd Full time

    About the Role :We are seeking a skilled and experienced Big Data Engineer to join our team and play a crucial role in building and maintaining our big data infrastructure. You will leverage your expertise in the Hadoop ecosystem and data processing frameworks to design, implement, and optimize scalable data pipelines.Responsibilities : - Design, develop,...


  • Bangarapet, India Skan Full time

    Responsibilities & Deliverables: Guide the design and development of reusable Infrastructure as Code (IaC) components; create IaC test plans and execute testing across the lifecycle Deploy and support Cloud resources IaaS, PaaS, and/or SaaS, using infrastructure as code via CICD pipeline, K8 using Helm. Write automation scripts for building, deploying...

  • Data Enginer

    2 months ago


    Bengaluru, Karnataka, India NatWest Group Full time

    Our people work differently depending on their jobs and needs. From hybrid working to flexible hours, we have plenty of options that help our people to thrive. This role is based in India and as such all normal working days must be carried out in India. Join us as a Data Engineer - This is an exciting opportunity to use your technical expertise to...

  • Data Engineer

    4 weeks ago


    Karnataka, India Synechron Technologies Pvt. Ltd. Full time

    EducationDegree, Postgraduate in Computer Science or related field (or equivalent industry experience)ExperienceMinimum 5+ years of development and design experience in Java/Scala/Python with Flink, Beam (or Spark Streaming using Real Time data and not batch data) and Kafka.Technical Skills• Containerization and orchestration (Docker and...

  • Data Engineer

    4 weeks ago


    karnataka, India Synechron Technologies Pvt. Ltd. Full time

    Education Degree, Postgraduate in Computer Science or related field (or equivalent industry experience) Experience Minimum 5+ years of development and design experience in Java/Scala/Python with Flink, Beam (or Spark Streaming using Real Time data and not batch data) and Kafka. Technical Skills • Containerization and orchestration (Docker and...

  • Data Engineer

    4 weeks ago


    Karnataka, India Synechron Technologies Pvt. Ltd. Full time

    EducationDegree, Postgraduate in Computer Science or related field (or equivalent industry experience)ExperienceMinimum 5+ years of development and design experience in Java/Scala/Python with Flink, Beam (or Spark Streaming using Real Time data and not batch data) and Kafka.Technical Skills• Containerization and orchestration (Docker and...

  • Data Engineer

    3 weeks ago


    Karnataka, India Synechron Technologies Pvt. Ltd. Full time

    Education Degree, Postgraduate in Computer Science or related field (or equivalent industry experience) Experience Minimum 5+ years of development and design experience in Java/Scala/Python with Flink, Beam (or Spark Streaming using Real Time data and not batch data) and Kafka. Technical Skills • Containerization and orchestration (Docker and...

  • Engineer, Data

    4 weeks ago


    Karnataka, 560064, Bangalore, India Giant Eagle GCC Full time

    Job SummaryAs a Data Engineer on the Customer Loyalty & Experience team, you will be working on a team to bring customer-centric personalization to life. In this role, you will be empowered to develop data solutions in support of marketing analytics and data science by engaging with project managers, technology teams, analysts, and business partners to...

  • Engineer, Data

    4 weeks ago


    , Karnataka, India Giant Eagle GCC Full time

    Job SummaryAs a Data Engineer on the Customer Loyalty & Experience team, you will be working on a team to bring customer-centric personalization to life. In this role, you will be empowered to develop data solutions in support of marketing analytics and data science by engaging with project managers, technology teams, analysts, and business partners to...

  • Azure Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India DigitalCube Consultancy Full time

    **Azure Data Engineer** **Job Type - Full time** **Location - Bangalore/ Mumbai, India** **Responsibilities**: - Design, develop, and maintain scalable data pipelines using Azure Data Factory, Azure Databricks, and other Azure data services. - Utilize Databricks for big data analytics and real-time data processing, ensuring optimal performance and...


  • Bengaluru, Karnataka, India NTT DATA Full time

    Shift Timings: 1:00 PM IST to 11:00 PM IST Job Responsibilities: - Understand customizations to standard related to modules Mfg, Quality and Engineering - Understand integrations of other modules with Mfg, Quality and Engineering - Understand MES business process and integration with ERP LN - Write Functional, Regression and End to End Test Cases - Prepare...

  • Engineer Sr., Data

    1 month ago


    Karnataka, 560064, Bangalore, India Giant Eagle GCC Full time

    Job SummaryYou will be working on a team to bring customer-centric personalization to life. In this role, you will be empowered to develop data solutions in support of customer facing applications as well as analytics for internal teams and business. This leading technical and architecture role will collaborate with product managers, architects, technology...

  • Engineer Sr., Data

    1 month ago


    , Karnataka, India Giant Eagle GCC Full time

    Job SummaryYou will be working on a team to bring customer-centric personalization to life. In this role, you will be empowered to develop data solutions in support of customer facing applications as well as analytics for internal teams and business. This leading technical and architecture role will collaborate with product managers, architects, technology...

  • Engineer Sr., Data

    3 weeks ago


    , Karnataka, India Giant Eagle GCC Full time

    Job SummaryYou will be working on a team to bring customer-centric personalization to life. In this role, you will be empowered to develop data solutions in support of customer facing applications as well as analytics for internal teams and business. This leading technical and architecture role will collaborate with product managers, architects, technology...

  • Engineer Sr., Data

    4 weeks ago


    Karnataka, 560064, Bangalore, India Giant Eagle GCC Full time

    Job SummaryYou will be working on a team to bring customer-centric personalization to life. In this role, you will be empowered to develop data solutions in support of customer facing applications as well as analytics for internal teams and business. This leading technical and architecture role will collaborate with product managers, architects, technology...

  • Sdk Resource

    1 week ago


    Bengaluru, Karnataka, India NTT DATA Full time

    **Req ID**: 280859 We are currently seeking a SDK Resource to join our team in BENGALURU, Karnātaka (IN-KA), India (IN). **Roles & Responsibilities**: Responsible for programming and software development using various programming languages and related tools and frameworks, reviewing code written by other programmers, requirement gathering, bug fixing,...