Senior PySpark Developer
3 weeks ago
DataEconomy is seeking a highly skilled PySpark Developer to join our dynamic team.
About the Role:
- Design and implement robust metadata-driven data ingestion pipelines using PySpark.
- Collaborate with technical teams to develop innovative data solutions.
- Work closely with business stakeholders to understand and translate requirements into technical specifications.
- Conduct unit testing, system testing, and support during UAT.
- Demonstrate strong analytical and problem-solving skills, as well as a commitment to excellence in software development.
- Experience in the financial or banking domain is a plus.
Requirements:
- 4-6 years of experience in IT, with a minimum of 3 years of hands-on experience in Python and PySpark.
- Solid understanding of data warehousing concepts and ETL processes.
- Proficiency in Linux and Java is a plus.
- Experience with code versioning tools like Git, AWS CodeCommit, and CI/CD pipelines (e.g., AWS CodePipeline).
- Proven ability to build metadata-driven frameworks for data ingestion.
- Familiarity with various designs and architectural patterns.
What We Offer:
- Opportunities for professional growth and development.
- Be part of a dynamic and collaborative team.
Join DataEconomy and be part of a dynamic team driving data-driven solutions.
We're seeking highly skilled PySpark developers with 4-6 years of experience to join our team in Hyderabad or Pune.
-
Senior PySpark Developer
1 month ago
Hyderabad, Telangana, India Virtusa Full timeJob Title: Senior PySpark DeveloperWe are seeking a highly skilled Senior PySpark Developer to join our team at Virtusa.Key Responsibilities:Design, develop, and maintain large-scale data processing pipelines using PySpark.Collaborate with cross-functional teams to identify business requirements and develop solutions.Develop and maintain CI/CD pipelines to...
-
Senior PySpark Developer
4 weeks ago
Hyderabad, Telangana, India Chiselon Technologies Pvt Ltd Full timeWe are seeking a highly skilled Senior PySpark Developer to join our team at Chiselon Technologies Pvt Ltd.As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining scalable data processing applications using PySpark and Big data technologies.The ideal candidate will have a strong understanding of...
-
Senior PySpark Data Engineer
4 weeks ago
Hyderabad, Telangana, India DATAECONOMY Full timeData Ingestion PipelinesWe're seeking a highly skilled Senior PySpark Data Engineer to design and implement robust metadata-driven data ingestion pipelines using PySpark.Responsibilities:Collaborate with technical teams to develop innovative data solutions.Work closely with business stakeholders to understand and translate requirements into technical...
-
Senior Data Engineer
3 weeks ago
Hyderabad, Telangana, India DATAECONOMY Full timeDataEconomy is seeking a highly skilled Senior Data Engineer - PySpark to join our dynamic team in Hyderabad or Pune. As a key member of our data-driven solutions team, you will design and implement robust metadata-driven data ingestion pipelines using PySpark.Responsibilities:Design and implement data ingestion pipelines using PySpark, collaborating with...
-
Senior Data Engineer
1 month ago
Hyderabad, Telangana, India Alignity Solutions Full timeJob DescriptionWe are seeking a highly skilled Senior Data Engineer to join our team at Alignity Solutions. As a key member of our data engineering team, you will be responsible for designing, building, and optimizing data pipelines and workflows throughout the development lifecycle.Key Responsibilities:Data Pipeline Design and Development: Create and...
-
Senior Data Engineer
1 month ago
Hyderabad, Telangana, India DATAECONOMY Full timeDataEconomy is seeking a highly skilled PySpark Developer to join our dynamic team in Hyderabad or Pune. As a key member of our data-driven solutions team, you will design and implement robust metadata-driven data ingestion pipelines using PySpark.Key Responsibilities:Collaborate with technical teams to develop innovative data solutions that meet business...
-
Senior Data Engineer
3 weeks ago
Hyderabad, Telangana, India Risk Resources LLP Full timeAbout the RoleWe are seeking a highly skilled Pyspark and Databricks developer to join our team at Risk Resources LLP. As a key member of our data engineering team, you will play a crucial role in designing and developing data processing pipelines using Pyspark and Databricks.Key ResponsibilitiesData Pipeline DevelopmentCreate efficient and scalable data...
-
Senior Data Engineer Python Pyspark AWS
4 weeks ago
Hyderabad, Telangana, India Alignity Solutions Full timeData Engineer (Senior) - Python, Pyspark, AWSAbout the Role:We are seeking a highly skilled Data Engineer to join our team at Alignity Solutions. The ideal candidate will have a strong background in data engineering and experience working with Python, Pyspark, and AWS cloud services.Key Responsibilities:Design and Develop Data Pipelines:Create and maintain...
-
Senior Data Engineer
4 weeks ago
Hyderabad, Telangana, India Alignity Solutions Full timeh3 {color: #00698f;} ul {list-style-type: disc;}Looking for a challenging role where you can apply your data engineering skills? As a Senior Data Engineer at Alignity Solutions, you will design and develop data pipelines using Python, PySpark, and Spark SQL. Your expertise will be essential in creating robust, scalable data pipelines and ensuring optimal...
-
Big Data PySpark Developer
3 weeks ago
Hyderabad, Telangana, India Techno Wise Full timeWe are seeking a Data Engineering Specialist to join our team at Techno Wise, specializing in designing and building scalable data solutions using PySpark.Roles and ResponsibilitiesDesign, build, and unit test applications in Spark/PysparkIn-depth knowledge of Hadoop, Spark, and similar frameworksAbility to understand existing ETL logic to convert into...
-
Senior Data Engineer
4 weeks ago
Hyderabad, Telangana, India Tata Consultancy Services Full timeGreetings from Tata Consultancy ServicesJob Title: Digital PysparkLocation: Hyderabad(Face 2 Face interview)Experience Range: 6-10 YearsMinimum Qualification:15 years of full-time educationJob DescriptionMust-HaveAWS Glue/CLI/EMR, Pyspark, Presto, Unix Shell ScriptingGood-to-HaveSAS Base CodeResponsibility of / Expectations from the RoleKnowledge of the key...
-
Senior Data Engineer
1 month ago
Hyderabad, Telangana, India Risk Resources LLP Full timeJob SummaryWe are seeking a highly skilled Pyspark Databricks professional to join our team at Risk Resources LLP. The ideal candidate will have a strong background in developing and implementing data processing pipelines using Pyspark on the Databricks platform.Key ResponsibilitiesData Pipeline Development: Design and develop efficient data processing...
-
Lead PySpark Data Engineer
3 weeks ago
Hyderabad, Telangana, India Virtusa Full timeJob Title: Lead PySpark Data EngineerJob Summary:We are seeking a highly skilled Lead PySpark Data Engineer to join our team at Virtusa. The successful candidate will be responsible for developing, enhancing, and maintaining large-scale data processing systems using PySpark.Key Responsibilities:Design, develop, and deploy PySpark applications to process...
-
Senior Big Data Engineer
3 weeks ago
Hyderabad, Telangana, India DATAECONOMY Full timeJob SummaryWe are seeking a highly skilled PySpark Developer to join our dynamic team at DataEconomy. The ideal candidate will have a solid understanding of data warehousing concepts and ETL processes, as well as experience in designing and implementing robust metadata-driven data ingestion pipelines using PySpark.Key ResponsibilitiesDesign, implement, and...
-
Data Scientist with PySpark Expertise
1 month ago
Hyderabad, Telangana, India DATAECONOMY Full timeDataEconomy is seeking a highly skilled PySpark developer to join our dynamic team driving data-driven solutions. The ideal candidate will have 4-6 years of experience in IT, with a minimum of 3 years of hands-on experience in Python and PySpark. Responsibilities include designing and implementing robust metadata-driven data ingestion pipelines using...
-
Data Scientist
4 weeks ago
Hyderabad, Telangana, India Overture Rede Private Limited Full timeJob Title: Data EngineerLocation: Remote or Specify LocationJob Summary:Overture Rede Private Limited is seeking a highly skilled Data Engineer to design, build, and maintain scalable data pipelines using PySpark. The ideal candidate will have hands-on experience in writing PySpark scripts and managing Spark clusters. Additionally, they should have expertise...
-
Hyderabad, Telangana, India Tata Consultancy Services Full time{"text": "Overview:Tata Consultancy Services is seeking a skilled Big Data Developer with expertise in Python Pyspark to join our team. The ideal candidate will have a strong background in data processing, manipulation, and transformation using Spark transformations and actions.Key Responsibilities:Design and develop scalable data processing pipelines using...
-
Data Engineering Expert
4 weeks ago
Hyderabad, Telangana, India Risk Resources LLP Full timeAbout the RoleWe are seeking a highly skilled Data Engineering Expert to join our team at Risk Resources LLP. As a Pyspark Databricks Developer, you will play a critical role in developing and implementing data processing pipelines using Pyspark on the Databricks platform.Key ResponsibilitiesDesign and Develop Data Pipelines: Utilize Pyspark and Databricks...
-
Data Scientist with PySpark Expertise
1 month ago
Hyderabad, Telangana, India DATAECONOMY Full timeJob Title: PySpark DeveloperAbout the Role:DataEconomy is seeking a highly skilled PySpark developer to join our dynamic team in Hyderabad or Pune. As a key member of our team, you will design and implement robust metadata-driven data ingestion pipelines using PySpark.Responsibilities:Collaborate with technical teams to develop innovative data solutions.Work...
-
Data Engineer Azure Pyspark
1 month ago
Hyderabad, Telangana, India Overture Rede Private Limited Full timeJob Title: Data EngineerLocation: RemoteResponsibilities:Design, build, and maintain scalable data pipelines using PySpark on Databricks.Work with Delta Lake to ensure data reliability, consistency, and scalability.Utilize Azure Synapse for integrated analytics querying and big data processing.Develop and deploy data solutions on Azure, including data lakes,...