Big Data Engineer Specialist

5 days ago


Hyderabad, Telangana, India Zensar Technologies Full time
Job Description:
We are seeking a highly skilled Data Engineer to join our team at Zensar Technologies. This role involves working with big data technologies, optimizing spark jobs, and developing pySpark applications using Spark Dataframes in Python.

About the Role:
We require candidates with 5+ years of overall IT experience, including hands-on experience in big data technologies. Mandatory skills include proficiency in Python and PySpark, as well as version control tools like Git. Familiarity with Amazon's Analytics services such as Amazon EMR, Amazon Athena, AWS Glue, and compute services like Amazon Lambda, Amazon EC2 is also essential.

Key Responsibilities:
The successful candidate will be responsible for building pySpark applications, optimizing spark jobs, and working on Amazon's Storage services like S3. Good knowledge of data warehousing concepts, columnar storage formats, and compression techniques is also desirable.

Requirements:
Candidates should have hands-on experience in Python and PySpark, as well as good knowledge of data warehousing concepts, columnar storage formats, and compression techniques. Familiarity with Amazon's databases such as Aurora, RDS, Redshift, ElastiCache, and DynamoDB is also an asset.

Benefits:
This role offers a challenging and rewarding career opportunity with opportunities for growth and development. The ideal candidate will be passionate about working with big data technologies and have excellent problem-solving skills.

  • Hyderabad, Telangana, India data Remote Work Freelance Full time

    What can you tell your friends when they ask you what you do? We're looking for an experienced Big Data Engineer who can create innovative new products in the analytics and data space. You will participate in the development that creates the world's #1 mobile app analytics service. Together with the team, you will build out new product features and...


  • Hyderabad, Telangana, India Micron Semiconductor Asia Operations Pte. Ltd Full time

    **Job Title:** Big Data Architecture Specialist**Job Summary:**Micron Semiconductor Asia Operations Pte. Ltd is seeking a highly skilled and experienced Big Data Architecture Specialist to join our team.The ideal candidate will have a strong technical background in cloud data warehouse technologies, machine learning, and advanced analytics, with experience...


  • Hyderabad, Telangana, India data Remote Work Freelance Full time

    What can you tell your friends when they ask you what you do? "As a Data Analyst at data.ai, I help analyze, monitor, and deliver comprehensive and high-quality app market data to app professionals. I am empowered to work independently with the support of team members spread across APAC, AMER, and EMEA. I am the key contributor to the new and existing...


  • Hyderabad, Telangana, India Tata Consultancy Services Full time

    Tata Consultancy Services is seeking a highly skilled Big Data Analytics Specialist to join our team. As a key member of our big data analytics group, you will be responsible for designing and implementing big data analytics solutions using Azure Databricks.The ideal candidate will have 5+ years of experience in data engineering solutions on cloud platforms,...


  • Hyderabad, Telangana, India Rsn Ginfo Solutions Private Limited Full time

    Company OverviewRsn Ginfo Solutions Private Limited is an IT consulting firm that delivers innovative solutions to clients. Our team of experts stays up-to-date with the latest technology trends and provides high-quality services to clients across various industries.Job DescriptionWe are looking for a Big Data Solutions Specialist to join our data analytics...


  • Hyderabad, Telangana, India Enable Data Incorporated Full time

    Key ResponsibilitiesDesign and develop scalable and robust data solutions in the cloud using Apache Spark and Databricks.Gather and analyze data requirements from business stakeholders and identify opportunities for data-driven insights.Build and optimize data pipelines for data ingestion, processing, and integration using Spark and Databricks.Ensure data...

  • Big Data Engineer

    2 days ago


    Hyderabad, Telangana, India SMARTWORK IT SERVICES Full time

    Job Title : Big Data Engineer (Dynatrace)Location : Chennai, Bangalore, HyderabadExperience : 6-10 YearsRequired skills : Big Data, DynatraceJob Description : We are looking for an experienced Big Data Engineer (Dynatrace) with building scalable data pipelines and ensuring performance optimization through Dynatrace monitoring. This role requires a seasoned...


  • Hyderabad, Telangana, India Tata Consultancy Services Full time

    About the Job: Tata Consultancy Services is looking for a Big Data Integration Specialist to join our team. In this role, you will be responsible for designing, developing, and maintaining data pipelines using Azure Data Factory. About Your Responsibilities: You will be working closely with our data engineering team to design and develop complex data...

  • Big Data Engineer

    1 week ago


    Hyderabad, Telangana, India Questsphere Private ltd. Full time

    Our client is looking to deploy big data engineer at one of the worlds top product company R&D centre based out of Hyderabad. As a Big Data Engineer, you are going to work with cross-functional collaboration and communication with members from other teams.As an Engineer, you are responsible to analyze large data sets to identify errors . You are responsible...

  • Big data engineer

    2 weeks ago


    Hyderabad, Telangana, India Virtusa Full time

    Big data engineer - CREQ189284 Description Position: Big data engineer Primary: big data concepts, aws, pyspark Location: HYD Create Trigger based automation framework for Data Migration Identify roles/access needed for data migration from federated bucket to managed bucket and Build APIs for the same Integrate CDMS framework with Lake and Data bridge...

  • Big Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India Folks Palette LLP Full time

    Job Description : We are seeking an experienced Big Data Engineer with PySpark Developer to join our dynamic team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining scalable data solutions in a big data ecosystem. The ideal candidate will have a strong background in big data technologies,...


  • Hyderabad, Telangana, India Incedo Inc. Full time

    Incedo Inc. is seeking a highly skilled Data Engineer for Big Data to join our team. The ideal candidate will have strong technical, analytical, and problem-solving skills.We are looking for someone with experience in designing and building big data pipelines using CDH On-premise, Spark, PySpark, Scala, Python, NiFi, Hive, and NoSql DBs.The candidate should...

  • Big Data Engineer

    2 weeks ago


    Hyderabad, Telangana, India TechSophy Full time

    Job Description: Roles&Responsibilities : 1. As an Engineer, you are responsible to analyze large data sets to identify errors in the map. 2. As an Engineer, you are responsible to design and implement a complex algorithm for resolving the issue, review the solution with a team of engineers and analysts, and integrate the resulting solution into the...


  • Hyderabad, Telangana, India Virtusa Full time

    Big Data Python Engineer - CREQ191701 Description Role GDT WS Big Data Python Engineer Exp 5+ Location Pune/Hyderabad MUST Have Skills Design and implement data processing pipelines using Python + SCALA programming and big data technologies such as Hadoop, MapReduce, Hive, and Spark. Airflow Jenkins Understand business requirements to code up data assets...

  • AWS Big Data Engineer

    2 weeks ago


    Hyderabad, Telangana, India Tiger Analytics Full time

    Job Description We are looking for a Senior Data Engineer to be based out of our Chennai, Bangalore & Hyderabad offices. This role involves a combination of hands-on contribution, customer engagement, and technical team management. As a Senior Data Engineer, you will Design and build solutions for near real-time stream processing as well as batch...


  • Hyderabad, Telangana, India HSBC Full time

    Job DescriptionJob descriptionSome careers shine brighter than others.If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.HSBC is one...

  • Big Data Engineer

    4 days ago


    Hyderabad, Telangana, India Apollo HealthAxis Full time

    Job DescriptionAs a Big Data Engineer at Apollo HealthAxis, you will be responsible for designing and implementing large-scale data processing systems using distributed computing technologies. You will work closely with cross-functional teams to understand business requirements and translate them into effective data architecture and...


  • Hyderabad, Telangana, India Coforge Full time

    Coforge is looking for an experienced Python Big Data Engineer to join our team.The ideal candidate will have expertise in designing and developing big data processing systems using PySpark.Key Responsibilities:Design and implement big data processing pipelines using PySpark.Analyze complex data sets to identify trends and insights.Collaborate with...


  • Hyderabad, Telangana, India PRI Global Full time

    About the RolePRI Global is looking for an experienced Senior Big Data Engineer to lead our big data initiatives. In this role, you will be responsible for designing and implementing large-scale data architectures and systems.Develop and Implement Data ArchitecturesCollaborate with Engineering TeamsEvaluate System PerformanceTroubleshoot Complex IssuesKey...

  • Big Data Engineer

    2 weeks ago


    Hyderabad, Telangana, India Anicalls (Pty) Ltd Full time

    Big Data Engineer  Specification- • 2 – 7 years of recent experience in data engineering.• Bachelor's Degree or more in Computer Science or a related field. • A solid track record of data management showing your flawless execution and attention to detail.• Strong knowledge of and experience with statistics.• Programming experience, ideally...