Senior Big Data Specialist

1 day ago


Hyderabad, Telangana, India METAFOLKS TECHNOLOGIES Full time

We are seeking a highly skilled Senior Big Data Specialist to join our team at METAFOLKS TECHNOLOGIES. As a key contributor, you will play a pivotal role in designing and developing large-scale data pipelines using advanced technologies such as Apache Spark and PySpark.

Main Responsibilities:

  1. Data Ingestion and Processing: Extract data from various sources (databases, APIs, files) and process it efficiently to ensure timely insights.
  2. Data Quality and Integrity: Transform and clean data to guarantee accuracy and consistency throughout the data ecosystem.
  3. Data Warehousing and Lakes: Load data into cloud-based data warehouses, data lakes, or data marts to support agile data analysis.
  4. Data Modeling and Architecture: Design and implement highly scalable and adaptive data models that align with business objectives.
  5. Data Pipeline Development: Create robust, fault-tolerant, and well-structured data pipelines to cater to diverse stakeholder needs.
  6. Cloud Computing and Services: Leverage cloud platforms (AWS, GCP, or Azure) to develop innovative and efficient data solutions.
  7. Data Security and Governance: Implement robust data security and privacy best practices in cloud environments and enforce data governance policies.
  8. Collaboration and Communication: Work closely with data analysts and data scientists to understand their data requirements and provide tailored solutions.

Required Skills and Experience:

  • Advanced proficiency in Python and PySpark programming languages.
  • Extensive experience working with Apache Spark and its core components.
  • Deep understanding of SQL and database technologies.
  • Familiarity with cloud platforms (AWS, GCP, or Azure).
  • Knowledge of data warehousing and data lake concepts.
  • Proficiency in data visualization tools (Tableau, Power BI).
  • Strong problem-solving and analytical skills.
  • Excellent communication and collaboration skills.

Estimated Salary: $150,000 - $200,000 per year



  • Hyderabad, Telangana, India QuinTalent Inc Full time

    Are you a skilled data engineer looking for a new challenge? QuinTalent Inc is seeking a talented Senior Big Data Specialist to join our team in Hyderabad, Telangana.Job OverviewWe are looking for an experienced professional with expertise in building and optimizing data pipelines in a distributed environment. The ideal candidate will have a strong...


  • Hyderabad, Telangana, India Tata Consultancy Services Full time

    Job Description:We are seeking an experienced Senior Big Data Analytics Specialist to join our team at Tata Consultancy Services. In this role, you will be responsible for designing, developing, and deploying big data solutions using Hadoop, Spark, and other related technologies.Key Responsibilities:Design and implement big data architectures and pipelines...


  • Hyderabad, Telangana, India Resourcetree Full time

    About the TeamWe are seeking a skilled Big Data Specialist to join our team at Resourcetree. As a key member of our data engineering team, you will be responsible for designing and implementing modern data processing capabilities using big data technologies such as AWS Glue, Athena, and Redshift.You will work closely with stakeholders to ensure successful...


  • Hyderabad, Telangana, India Yogy HR Solutions Full time

    We're seeking a highly skilled Big Data Solutions Specialist to join our team at Yogy HR Solutions. In this role, you'll be responsible for designing, developing, and implementing big data solutions that meet the needs of our clients.We're offering a competitive salary of $140,000 per year, plus benefits.Required Skills and QualificationsThe ideal candidate...


  • Hyderabad, Telangana, India data Full time

    About the RoleWe are seeking an experienced Big Data Solutions Engineer to join our team in Hyderabad, India. As a key member of our engineering team, you will be responsible for designing and implementing complex data products components based on requirements with possible technical solutions.You will work closely with Data Scientists, Data Engineers,...


  • Hyderabad, Telangana, India data Full time

    About the RoleWe are seeking a highly skilled Data Intelligence Specialist to join our engineering team in Hyderabad, India.The ideal candidate will have a strong passion for data analysis and quality monitoring, with a deep understanding of complex datasets and statistical measurements.Key ResponsibilitiesTake full ownership of data.ai core intelligence...


  • Hyderabad, Telangana, India Tata Consultancy Services Full time

    Job Title: Senior Big Data ArchitectWe are seeking a highly skilled Senior Big Data Architect to join our team at Tata Consultancy Services. About the Role:The ideal candidate will have extensive experience in designing and implementing complex ETL pipelines using Spark toolset, with a strong focus on data architecture and big data technologies. Key...


  • Hyderabad, Telangana, India Optum Full time

    About the RoleWe are seeking a highly skilled Data Engineering Specialist to join our team in Cloud and Big Data Engineering. As a key member of our engineering team, you will play a crucial role in designing, developing, and maintaining large-scale data processing systems.


  • Hyderabad, Telangana, India S P A Enterprise Full time

    Job Title: Senior Big Data ArchitectAbout Us:S P A Enterprise is a leading organization in the industry, dedicated to delivering high-quality solutions and services. We are currently seeking an experienced Senior Big Data Architect to join our team.Salary: $140,000 - $180,000 per year, depending on experience.Job Description:We are looking for a highly...


  • Hyderabad, Telangana, India Tata Consultancy Services Full time

    Job Title: Senior Big Data EngineerAbout Us: Tata Consultancy Services, a global leader in IT services and consulting, is seeking an experienced Senior Big Data Engineer to join our team.Estimated Salary: ₹1,200,000 - ₹1,500,000 per annum (dependent on location and experience).Job Description:The successful candidate will have hands-on experience with...


  • Hyderabad, Telangana, India Tech Mahindra Full time

    Job SummaryA senior role in our team is available for an experienced Data Engineer.About Tech MahindraWe are a leading provider of digital transformation and business re-engineering services and solutions. Our unique, client-centric, collaborative approach helps us to deliver successful outcomes for our clients.Salary RangeThe salary range for this position...


  • Hyderabad, Telangana, India Tata Consultancy Services Full time

    Job DescriptionAbout the Role:We are seeking an experienced Senior Big Data Engineer to join our team at Tata Consultancy Services. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale big data environments using PySpark.Key Responsibilities:Design and implement complex big data...


  • Hyderabad, Telangana, India Tata Consultancy Services Full time

    Job Title: Big Data Analytics SpecialistAbout the Role:Tata Consultancy Services is seeking a skilled PySpark Developer to join our team as a Data Engineering specialist. This role will involve designing and implementing data pipelines using PySpark, working on large datasets, and developing expertise in Hadoop and SQL.Responsibilities:- Design and implement...


  • Hyderabad, Telangana, India US Technology International Pvt Ltd Full time

    Job SummaryWe are seeking a highly skilled Senior Big Data Developer to join our team at US Technology International Pvt Ltd. As a Senior Big Data Developer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Spark/Scala.Key Responsibilities:Design and develop scalable data processing systems using...


  • Hyderabad, Telangana, India Tata Consultancy Services Full time

    Tata Consultancy Services is a leading IT services company seeking an experienced Senior Cloud Big Data Engineer to join our team in Hyderabad. The successful candidate will have 5-10 years of experience in developing scalable big data applications using Python and AWS services.Key ResponsibilitiesDevelop and maintain high-performance big data solutions...


  • Hyderabad, Telangana, India Orbcomm Full time

    Transformative Opportunity for a Senior Big Data Architecture LeadWe are seeking an exceptional individual to lead our big data architecture initiatives, driving innovation and excellence in our IoT technology solutions.About the Role:As a Senior Big Data Architecture Lead at ORBCOMM, you will be responsible for designing and developing scalable data...


  • Hyderabad, Telangana, India People Tech Group Inc Full time

    We are seeking a highly skilled Senior Big Data Engineer to join our team at People Tech Group Inc. This is a fantastic opportunity for someone looking to leverage their expertise in big data processing and analytics to drive business growth.Job DescriptionIn this role, you will be responsible for designing, developing, and implementing large-scale data...


  • Hyderabad, Telangana, India Selsoft Full time

    Data Engineer Required:We're looking for an experienced Data Engineer to work on big data projects at Selsoft. The ideal candidate will have strong programming skills, knowledge of cloud platforms, and expertise in data governance and security.About the Role:Implement efficient data processing using open table formats Delta and Iceberg.Work on designing and...


  • Hyderabad, Telangana, India People Tech Group Inc Full time

    **Job Overview**We are People Tech Group Inc., a leading company in the field of big data solutions. We are currently seeking a highly skilled Senior Hadoop Engineer to join our team in Pune.The ideal candidate will have extensive experience in working with Hadoop ecosystem, including Spark, Python, Hive, and Impala. They should also be proficient in Unix,...


  • Hyderabad, Telangana, India Tiger Analytics Full time

    Job DescriptionWe are looking for a Senior Data Engineer to join our Tiger Analytics team based out of Chennai, Bangalore & Hyderabad offices.This role involves a combination of hands-on contribution, customer engagement, and technical team management. As a Senior Data Engineer, you will design and build solutions for near real-time stream processing as well...