Data Scientist with PySpark Expertise

3 weeks ago


Hyderabad, Telangana, India DATAECONOMY Full time

DataEconomy is seeking a highly skilled PySpark developer to join our dynamic team driving data-driven solutions. The ideal candidate will have 4-6 years of experience in IT, with a minimum of 3 years of hands-on experience in Python and PySpark. Responsibilities include designing and implementing robust metadata-driven data ingestion pipelines using PySpark, collaborating with technical teams to develop innovative data solutions, and working closely with business stakeholders to understand and translate requirements into technical specifications.

Requirements:

  • 4-6 years of experience in IT, with a minimum of 3 years of hands-on experience in Python and PySpark.
  • Solid understanding of data warehousing concepts and ETL processes.
  • Proficiency in Linux and Java is a plus.
  • Experience with code versioning tools like Git, AWS CodeCommit, and CI/CD pipelines (e.g., AWS CodePipeline).
  • Proven ability to build metadata-driven frameworks for data ingestion.
  • Familiarity with various designs and architectural patterns.

Benefits:

  • Opportunities for professional growth and development.
  • Be part of a dynamic and collaborative team.

About DataEconomy:

DataEconomy is a dynamic team driving data-driven solutions. We're seeking highly skilled PySpark developers with 4-6 years of experience to join our team in Hyderabad or Pune.


  • Data Scientist

    3 weeks ago


    Hyderabad, Telangana, India Overture Rede Private Limited Full time

    Job Title: Data EngineerLocation: Remote or Specify LocationJob Summary:Overture Rede Private Limited is seeking a highly skilled Data Engineer to design, build, and maintain scalable data pipelines using PySpark. The ideal candidate will have hands-on experience in writing PySpark scripts and managing Spark clusters. Additionally, they should have expertise...


  • Hyderabad, Telangana, India DATAECONOMY Full time

    Job OpportunityDataEconomy is seeking a highly skilled PySpark developer to join our dynamic team in Hyderabad or Pune. As a key member of our team, you will design and implement robust metadata-driven data ingestion pipelines using PySpark. Your expertise will be crucial in developing innovative data solutions and collaborating with technical teams to drive...


  • Hyderabad, Telangana, India DATAECONOMY Full time

    DataEconomy is seeking a highly skilled PySpark Developer to join our dynamic team driving data-driven solutions. The ideal candidate will have 4-6 years of experience in IT, with a minimum of 3 years of hands-on experience in Python and PySpark. Responsibilities include designing and implementing robust metadata-driven data ingestion pipelines using...


  • Hyderabad, Telangana, India DATAECONOMY Full time

    Job Title: PySpark DeveloperAbout the Role:DataEconomy is seeking a highly skilled PySpark developer to join our dynamic team in Hyderabad or Pune. As a key member of our team, you will design and implement robust metadata-driven data ingestion pipelines using PySpark.Responsibilities:Collaborate with technical teams to develop innovative data solutions.Work...


  • Hyderabad, Telangana, India AppSierra Solutions Pvt Ltd Full time

    AppSierra Solutions Data Engineer Job DescriptionOverviewWe are seeking a highly skilled Data Engineer with expertise in Azure, SQL, and Pyspark to work with our team at AppSierra Solutions Pvt Ltd. The ideal candidate will have strong hands-on experience with SQL and database technologies, proficiency in Pyspark for data processing and analytics, and...


  • Hyderabad, Telangana, India Overture Rede Private Limited Full time

    Job Title: Data EngineerLocation: RemoteResponsibilities:As a Data Engineer at Overture Rede Private Limited, you will design, build, and maintain scalable data pipelines using PySpark on Data bricks. You will work with Delta Lake to ensure data reliability, consistency, and scalability. You will utilize Azure Synapse for integrated analytics querying and...


  • Hyderabad, Telangana, India Overture Rede Private Limited Full time

    Job Title: Data EngineerLocation: RemoteResponsibilities:Design, build, and maintain scalable data pipelines using PySpark on Databricks.Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver solutions.Monitor and optimize data pipelines for performance and cost efficiency.Requirements:Experience with...


  • Hyderabad, Telangana, India Overture Rede Private Limited Full time

    Job Title: Data EngineerLocation: RemoteResponsibilities:Design, build, and maintain scalable data pipelines using PySpark on Databricks.Work with Delta Lake to ensure data reliability, consistency, and scalability.Utilize Azure Synapse for integrated analytics querying and big data processing.Develop and deploy data solutions on Azure, including data lakes,...


  • Hyderabad, Telangana, India Micron Full time

    At Micron, we are shaping the future of memory and storage solutions to drive progress in various industries. Our cutting-edge technology accelerates the transformation of information into intelligence, enabling faster learning, communication, and advancement.Compensation: We offer a highly competitive salary ranging from $180,000 to $250,000 per annum,...


  • Hyderabad, Telangana, India Overture Rede Private Limited Full time

    "Job Title: Data EngineerJob Summary: We are seeking a skilled Data Engineer to join our team at Overture Rede Private Limited. The ideal candidate will have hands-on experience with PySpark, Delta Lake, and Azure Synapse, with a focus on designing, building, and maintaining scalable data pipelines.Responsibilities:• Design and develop scalable data...


  • Hyderabad, Telangana, India DATAECONOMY Full time

    {"Responsibilities": {"ul": [{"li": "Design and implement robust metadata-driven data ingestion pipelines using PySpark."},{"li": "Collaborate with technical teams to develop innovative data solutions."},{"li": "Work closely with business stakeholders to understand and translate requirements into technical specifications."},{"li": "Conduct unit testing,...

  • Big Data Engineer

    2 weeks ago


    Hyderabad, Telangana, India data Full time

    Overview: We're seeking a skilled Big Data Engineer to join our team at data.ai. As a key member of our engineering team, you will be responsible for designing and implementing innovative data solutions that drive business growth. If you're passionate about working with large data sets, have experience with big data technologies, and are eager to...


  • Hyderabad, Telangana, India Tata Consultancy Services Full time

    {"text": "Overview:Tata Consultancy Services is seeking a skilled Big Data Developer with expertise in Python Pyspark to join our team. The ideal candidate will have a strong background in data processing, manipulation, and transformation using Spark transformations and actions.Key Responsibilities:Design and develop scalable data processing pipelines using...

  • Data Engineer

    2 weeks ago


    Hyderabad, Telangana, India AppSierra Solutions Pvt Ltd Full time

    About the Role:We are seeking a highly skilled Data Engineer with expertise in Azure, SQL, and Pyspark to design and implement data solutions for our organization. As a Data Engineer, you will work closely with our data scientists and analysts to understand data requirements and ensure the quality, availability, and accessibility of our data.Key...

  • Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India Risk Resources LLP Full time

    Job Title: Data Engineer - Pyspark Databricks SpecialistAbout the RoleRisk Resources LLP is seeking a skilled Data Engineer to join our team. As a Data Engineer - Pyspark Databricks Specialist, you will be responsible for developing and implementing data processing pipelines using Pyspark on the Databricks platform.Key ResponsibilitiesDesign and Develop Data...


  • Hyderabad, Telangana, India data Full time

    About the RoleWe are seeking an experienced Big Data Engineer to join our team at data.ai. As a key member of our engineering team, you will be responsible for designing and implementing complex data product components based on requirements with possible technical solutions.Key ResponsibilitiesDesign and implement data processing programs using Python (e.g.,...

  • Big Data Engineer

    4 weeks ago


    Hyderabad, Telangana, India data Full time

    About the RoleWe are seeking an experienced Big Data Engineer to join our team in Hyderabad, India. As a key member of our engineering team, you will be responsible for designing and implementing complex data product components based on requirements with possible technical solutions.Key ResponsibilitiesDesign and implement data processing programs using...


  • Hyderabad, Telangana, India Risk Resources LLP Full time

    Job Title: Pyspark Databricks EngineerJob Summary:We are seeking a highly skilled Pyspark Databricks Engineer to join our team at Risk Resources LLP. The successful candidate will be responsible for designing and developing data processing pipelines using Pyspark and Databricks, optimizing and tuning the performance of Spark jobs and clusters, and...


  • Hyderabad, Telangana, India Risk Resources LLP Full time

    Job SummaryWe are seeking a highly skilled Pyspark Databricks engineer to join our team at Risk Resources LLP. The successful candidate will be responsible for designing and developing data processing pipelines using Pyspark on the Databricks platform.Key ResponsibilitiesDesign and develop data processing pipelines using Pyspark and Databricks.Optimize and...

  • Senior Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India Risk Resources LLP Full time

    Job SummaryWe are seeking a highly skilled Pyspark Databricks professional to join our team at Risk Resources LLP. The ideal candidate will have a strong background in developing and implementing data processing pipelines using Pyspark on the Databricks platform.Key ResponsibilitiesData Pipeline Development: Design and develop efficient data processing...