Python Hadoop Data Engineer

2 weeks ago

Bangalore Karnataka, India Tech Mahindra Full time

Job Title Data Engineer Location TechM Blr ITPL Years of Experience 7 10 Years Job Summary We are seeking a highly skilled Data Engineer with a strong background in PySpark to join our dynamic team The ideal candidate will have 7 10 years of experience in data engineering with a proven track record of designing building and maintaining scalable data pipelines You will play a crucial role in transforming raw data into actionable insights enabling data driven decision making across the organization Skills Python Pyspark Hadoop HiveQL Devops Responsibilities Design develop and maintain robust data pipelines using PySpark to process large datasets efficiently Collaborate with data scientists and analysts to understand data requirements and deliver high quality data solutions Implement data integration processes from various sources ensuring data quality and consistency Optimize existing data workflows and troubleshoot performance issues to enhance data processing efficiency Work with cloud based data platforms and tools to manage and store data securely Document data engineering processes and maintain clear communication with stakeholders regarding project status and challenges Stay updated with the latest industry trends and technologies in data engineering and big data Mandatory Skills Strong expertise in PySpark for data processing and transformation Proficient in SQL and experience with relational databases Experience with data warehousing solutions and ETL processes Familiarity with cloud platforms such as AWS Azure or Google Cloud Solid understanding of data modeling and data architecture principles Ability to work in a fast paced environment and manage multiple priorities effectively Preferred Skills Experience with Apache Kafka or similar streaming technologies Knowledge of machine learning concepts and frameworks Familiarity with containerization technologies like Docker Experience with version control systems such as Git Strong analytical and problem solving skills Qualifications Bachelor s or Master s degree in Computer Science Information Technology or a related field 7 10 years of experience in data engineering or a related role Proven experience in building and optimizing data pipelines using PySpark Excellent communication skills and the ability to work collaboratively in a team environment If you are passionate about data engineering and possess the required skills we invite you to apply and join our innovative team at TechM Blr ITPL Tech Mahindra represents the connected world offering innovative and customer-centric information technology experiences enabling Enterprises Associates and the Society to Rise We are a USD 4 9 billion company with 121 840 professionals across 90 countries helping over 935 global customers including Fortune 500 companies Our convergent digital design experiences innovation platforms and reusable assets connect across a number of technologies to deliver tangible business value and experiences to our stakeholders Tech Mahindra is the highest ranked Non-U S company in the Forbes Global Digital 100 list 2018 and in the Forbes Fab 50 companies in Asia 2018

  • Data Engineer(Python

    2 weeks ago

    bangalore, India ACL Digital Full time

    🚀 We’re Hiring: Data Engineers(Python , Hadoop , Hive) – Bangalore 🚀Are you passionate about building your career in Data Engineering? We’re looking for talented Data Engineers with 4+ years of experience to join our Bangalore team!Location: BangaloreExperience: 4+ YearsInterview Mode: Face-to-Face ONLYJD:· Technical Skills and Platforms:...

  • Data Engineer(Python

    3 days ago

    bangalore, India ACL Digital Full time

    We're Hiring: Data Engineers(Python , Hadoop , Hive) – Bangalore Are you passionate about building your career in Data Engineering? We're looking for talented Data Engineers with 4+ years of experience to join our Bangalore teamLocation: BangaloreExperience: 4+ YearsInterview Mode: Face-to-Face ONLYJD:· Technical Skills and Platforms: Python, Hadoop,...

  • Data Engineer-Hadoop, Apache Spark, Python and SQL

    4 weeks ago

    Bangalore, India Visa Full time

    Job DescriptionTBD QualificationsBasic Qualification:Bachelor's degree, OR 3+ years of relevant work experiencePreferred Qualification:Bachelor's degree, OR 3+ years of relevant work experienceMaster's or bachelor's degree in computer science or related fields required.Demonstrated ability in delivering high-quality, large-scale, enterprise-class data...

  • Hadoop Administrator

    2 weeks ago

    Bangalore, Karnataka, India Maneva Consulting Full time

    Greetings from Maneva Job Title - Hadoop Administrator Experience - 6 - 12 Years Location - Bangalore Notice - Immediate to 15 days Requirements - Install configure and manage Hadoop clusters HDFS YARN Spark etc Monitor the health and performance of the Hadoop clusters and troubleshoot issues Implement and manage security policies and procedures within the...

  • Lead Ii

    4 weeks ago

    Bangalore, Karnataka, India UST Full time

    Position Senior Data Engineer Python Devops Experience 7-8 Years Work Location Bangalore Hyderabad Mumbai Kolkata Hybrid Work Hours 2 PM - 11 PM IST Job Summary We are seeking a Senior Data Engineer with strong Python and Devops development skills to join our team The ideal candidate should have 7-8 years of experience in data engineering Python development...

  • Hadoop Admin

    4 days ago

    Bangalore, Karnataka, India Diverse Lynx Full time

    Big Data Admin CWR Deploying a hadoop cluster maintaining a hadoop cluster adding and removing nodes using cluster monitoring tools like Ganglia Nagios or Cloudera Manager configuring the NameNode high availability and keeping a track of all the running hadoop jobs Implementing managing and administering the overall hadoop infrastructure Ensure that the...

  • Hadoop Platform Engineer

    7 days ago

    Bangalore, India Andor Tech Full time

    We're Hiring: Hadoop Platform Engineer Are you an expert in Apache Hadoop, Hive, Spark, Java, and Linux? Join us to build and maintain a scalable, high-performance data platform that powers large-scale analytics. Location: Manyata Tech Park, Bangalore Experience: 10+ Years Company: Andor Tech (Deployed at a Product-Based Retail MNC) Key Skills: Apache Hadoop...

  • Senior Hadoop Developer

    3 weeks ago

    bangalore, India Information Tech Consultants Full time

    Job Title: Senior Big Data Developer Location: UK (Relocation Required - Sponsorship will be provided) Experience: 8-14 years Education: Bachelors in Science (IT/Computer Science/Engineer) Employment Type: Full-Time UK based candidates only. Role Overview: We are seeking an experienced Scala /Hadoop/ Big Data Developer . The role will focus on building and...

  • Data Engineer

    4 days ago

    bangalore, India AMISEQ Full time

    Data Engineer Bengaluru, KAJob Description:As a Data Engineer on our team, you will work on our Hadoop-based data warehouse, contributing to scalable and reliable big data solutions for analytics and business insights. This is a hands-on role focused on building, optimizing, and maintaining large data pipelines and warehouse infrastructure.Key...

  • Hadoop Platform Engineer

    2 weeks ago

    bangalore district, India Andor Tech Full time

    🚀 We’re Hiring: Hadoop Platform Engineer 🚀 Are you an expert in Apache Hadoop, Hive, Spark, Java, and Linux ? Join us to build and maintain a scalable, high-performance data platform that powers large-scale analytics. 📍 Location: Manyata Tech Park, Bangalore 💼 Experience: 10+ Years 🏢 Company: Andor Tech (Deployed at a Product-Based Retail...