Data Engineer with Expertise in PySpark

1 week ago


Hyderabad, Telangana, India DATAECONOMY Full time

{"Responsibilities": {"ul": [{"li": "Design and implement robust metadata-driven data ingestion pipelines using PySpark."},{"li": "Collaborate with technical teams to develop innovative data solutions."},{"li": "Work closely with business stakeholders to understand and translate requirements into technical specifications."},{"li": "Conduct unit testing, system testing, and support during UAT."},{"li": "Demonstrate strong analytical and problem-solving skills and a commitment to excellence in software development."},{"li": "Experience in the financial or banking domain is a plus."}]},"Requirements": {"ul": [{"li": "4-6 years of experience in IT, with a minimum of 3 years of hands-on experience in Python and PySpark."},{"li": "Solid understanding of data warehousing concepts and ETL processes."},{"li": "Proficiency in Linux and Java is a plus."},{"li": "Experience with code versioning tools like Git, AWS CodeCommit, and CI/CD pipelines (e.g., AWS CodePipeline)."},{"li": "Proven ability to build metadata-driven frameworks for data ingestion."},{"li": "Familiarity with various designs and architectural patterns."}]},"Benefits": {"ul": [{"li": "Opportunities for professional growth and development."},{"li": "Be part of a dynamic and collaborative team."}]}}



  • Hyderabad, Telangana, India AppSierra Solutions Pvt Ltd Full time

    AppSierra Solutions Data Engineer Job DescriptionOverviewWe are seeking a highly skilled Data Engineer with expertise in Azure, SQL, and Pyspark to work with our team at AppSierra Solutions Pvt Ltd. The ideal candidate will have strong hands-on experience with SQL and database technologies, proficiency in Pyspark for data processing and analytics, and...


  • Hyderabad, Telangana, India DATAECONOMY Full time

    Job OpportunityDataEconomy is seeking a highly skilled PySpark developer to join our dynamic team in Hyderabad or Pune. As a key member of our team, you will design and implement robust metadata-driven data ingestion pipelines using PySpark. Your expertise will be crucial in developing innovative data solutions and collaborating with technical teams to drive...


  • Hyderabad, Telangana, India Overture Rede Private Limited Full time

    Job Title: Data EngineerLocation: RemoteResponsibilities:As a Data Engineer at Overture Rede Private Limited, you will design, build, and maintain scalable data pipelines using PySpark on Data bricks. You will work with Delta Lake to ensure data reliability, consistency, and scalability. You will utilize Azure Synapse for integrated analytics querying and...


  • Hyderabad, Telangana, India Overture Rede Private Limited Full time

    Job Title: Data EngineerLocation: RemoteResponsibilities:Design, build, and maintain scalable data pipelines using PySpark on Databricks.Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver solutions.Monitor and optimize data pipelines for performance and cost efficiency.Requirements:Experience with...


  • Hyderabad, Telangana, India DATAECONOMY Full time

    DataEconomy is seeking a highly skilled PySpark developer to join our dynamic team driving data-driven solutions. The ideal candidate will have 4-6 years of experience in IT, with a minimum of 3 years of hands-on experience in Python and PySpark. Responsibilities include designing and implementing robust metadata-driven data ingestion pipelines using...


  • Hyderabad, Telangana, India DATAECONOMY Full time

    DataEconomy is seeking a highly skilled PySpark Developer to join our dynamic team driving data-driven solutions. The ideal candidate will have 4-6 years of experience in IT, with a minimum of 3 years of hands-on experience in Python and PySpark. Responsibilities include designing and implementing robust metadata-driven data ingestion pipelines using...


  • Hyderabad, Telangana, India DATAECONOMY Full time

    Job Title: PySpark DeveloperAbout the Role:DataEconomy is seeking a highly skilled PySpark developer to join our dynamic team in Hyderabad or Pune. As a key member of our team, you will design and implement robust metadata-driven data ingestion pipelines using PySpark.Responsibilities:Collaborate with technical teams to develop innovative data solutions.Work...


  • Hyderabad, Telangana, India Overture Rede Private Limited Full time

    Job Title: Data EngineerLocation: RemoteResponsibilities:Design, build, and maintain scalable data pipelines using PySpark on Databricks.Work with Delta Lake to ensure data reliability, consistency, and scalability.Utilize Azure Synapse for integrated analytics querying and big data processing.Develop and deploy data solutions on Azure, including data lakes,...

  • Data Scientist

    2 weeks ago


    Hyderabad, Telangana, India Overture Rede Private Limited Full time

    Job Title: Data EngineerLocation: Remote or Specify LocationJob Summary:Overture Rede Private Limited is seeking a highly skilled Data Engineer to design, build, and maintain scalable data pipelines using PySpark. The ideal candidate will have hands-on experience in writing PySpark scripts and managing Spark clusters. Additionally, they should have expertise...


  • Hyderabad, Telangana, India DATAECONOMY Full time

    Data Ingestion PipelinesWe're seeking a highly skilled Senior PySpark Data Engineer to design and implement robust metadata-driven data ingestion pipelines using PySpark.Responsibilities:Collaborate with technical teams to develop innovative data solutions.Work closely with business stakeholders to understand and translate requirements into technical...

  • Data Engineer

    2 weeks ago


    Hyderabad, Telangana, India Risk Resources LLP Full time

    Job Title: Data Engineer - Pyspark Databricks SpecialistAbout the RoleRisk Resources LLP is seeking a skilled Data Engineer to join our team. As a Data Engineer - Pyspark Databricks Specialist, you will be responsible for developing and implementing data processing pipelines using Pyspark on the Databricks platform.Key ResponsibilitiesDesign and Develop Data...

  • Senior Data Engineer

    2 weeks ago


    Hyderabad, Telangana, India DATAECONOMY Full time

    Job Title: Senior Data Engineer - PySparkAbout the Role:We are seeking a highly skilled Senior Data Engineer - PySpark to join our team at DataEconomy. As a Senior Data Engineer - PySpark, you will be responsible for designing and implementing robust metadata-driven data ingestion pipelines using PySpark. You will work closely with technical teams to develop...


  • Hyderabad, Telangana, India Tata Consultancy Services Full time

    {"text": "Overview:Tata Consultancy Services is seeking a skilled Big Data Developer with expertise in Python Pyspark to join our team. The ideal candidate will have a strong background in data processing, manipulation, and transformation using Spark transformations and actions.Key Responsibilities:Design and develop scalable data processing pipelines using...

  • Senior Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India Tata Consultancy Services Full time

    Job Title: Senior Data Engineer - Python PysparkLocation: Kolkata, Mumbai, HyderabadExperience: 6-10 YearsJob Description:We are seeking a highly skilled Senior Data Engineer with expertise in Python Pyspark to join our team at Tata Consultancy Services. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale...


  • Hyderabad, Telangana, India Virtusa Full time

    Job Title: Lead PySpark Data EngineerJob Summary:We are seeking a highly skilled Lead PySpark Data Engineer to join our team at Virtusa. The successful candidate will be responsible for developing, enhancing, and maintaining large-scale data processing systems using PySpark.Key Responsibilities:Design, develop, and deploy PySpark applications to process...


  • Hyderabad, Telangana, India Risk Resources LLP Full time

    Job Title: Pyspark Databricks EngineerJob Summary:We are seeking a highly skilled Pyspark Databricks Engineer to join our team at Risk Resources LLP. The successful candidate will be responsible for designing and developing data processing pipelines using Pyspark and Databricks, optimizing and tuning the performance of Spark jobs and clusters, and...


  • Hyderabad, Telangana, India Risk Resources LLP Full time

    Job SummaryWe are seeking a highly skilled Pyspark Databricks engineer to join our team at Risk Resources LLP. The successful candidate will be responsible for designing and developing data processing pipelines using Pyspark on the Databricks platform.Key ResponsibilitiesDesign and develop data processing pipelines using Pyspark and Databricks.Optimize and...

  • Senior Data Engineer

    2 weeks ago


    Hyderabad, Telangana, India Alignity Solutions Full time

    Job Title: Senior Data Engineer - Python Pyspark and AWSJob Summary:We are seeking a highly skilled Senior Data Engineer to join our team at Alignity Solutions. As a Senior Data Engineer, you will be responsible for designing, building, and optimizing data pipelines using Python, PySpark, and AWS cloud services.Key Responsibilities:Design and develop data...

  • Senior Data Engineer

    2 weeks ago


    Hyderabad, Telangana, India Alignity Solutions Full time

    h3 {color: #00698f;} ul {list-style-type: disc;}Looking for a challenging role where you can apply your data engineering skills? As a Senior Data Engineer at Alignity Solutions, you will design and develop data pipelines using Python, PySpark, and Spark SQL. Your expertise will be essential in creating robust, scalable data pipelines and ensuring optimal...

  • Senior Data Engineer

    2 weeks ago


    Hyderabad, Telangana, India Risk Resources LLP Full time

    Job SummaryWe are seeking a highly skilled Pyspark Databricks professional to join our team at Risk Resources LLP. The ideal candidate will have a strong background in developing and implementing data processing pipelines using Pyspark on the Databricks platform.Key ResponsibilitiesData Pipeline Development: Design and develop efficient data processing...