Data Engineer – AWS Glue, Redshift,, PySpark

3 days ago

Hyderabad, Telangana, India Cyepro Solutions Full time ₹ 12,00,000 - ₹ 24,00,000 per year

Company Overview:

Cyepro Solutions is at the forefront of innovation in customer relationship management, specializing in the automotive industry. We offer a platform that empowers dealerships, manufacturers, and service providers to enhance customer experiences and streamline operations. Headquartered in Hyderabad, Telangana, with a team of employees, Cyepro Solutions is dedicated to transforming automotive CRM and delivering sustainable growth solutions. Explore more about us at Cyepro Solutions.

Job Overview:

We are seeking a talented Data Engineer to join our team at Cyepro Solutions. Located in Hyderabad, this mid-level position is a full-time role that focuses on leveraging cutting-edge technologies to transform data operations and contribute to our CRM solutions. The successful candidate will work in a dynamic environment with opportunities to impact our company's future success.

Qualifications and Skills:

  • AWS Glue (Mandatory skill) - Extensive experience in using AWS Glue for data integration and ETL processes.
  • PySpark (Mandatory skill) - Proficient in developing data processing frameworks and workflows using PySpark.
  • Redshift (Mandatory skill) - In-depth knowledge and experience in optimizing and managing Amazon Redshift clusters.
  • Python - Strong programming skills in Python for data manipulation and analysis.
  • ETL - Experience with Extract, Transform, Load (ETL) processes in large-scale data environments.
  • Strong analytical and troubleshooting skills for resolving data processing issues effectively.
  • Ability to work collaboratively in a team and communicate effectively with technical and non-technical stakeholders.
  • Familiarity with data modeling and database design concepts, ensuring the reliability and efficiency of data systems.

Roles and Responsibilities:

  • Design, develop, and maintain scalable ETL processes using AWS Glue and PySpark.
  • Optimize Redshift clusters for performance, ensuring data accuracy and efficiency in processing.
  • Collaborate with cross-functional teams to understand data needs and deliver appropriate data solutions.
  • Develop and automate data pipelines to support data analytics and business intelligence efforts.
  • Monitor and troubleshoot data workflow issues to ensure data reliability and availability.
  • Participate in code reviews and provide constructive feedback to maintain code quality standards.
  • Document data processes and pipelines to facilitate knowledge sharing and stakeholder understanding.
  • Stay updated with the latest industry trends and best practices in data engineering and AWS services.

  • Date Engineer(Python, Pyspark and AWS)

    1 week ago

    Hyderabad, Telangana, India Zorba AI Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Key Skills Required-Minimum 6 years of working experience in Python, Pyspark, AWS and SQL.Programming & Frameworks: Python, PySparkDatabases & Querying: Strong SQL (query optimization, joins, window functions)Big Data & Processing: PySpark for distributed data processing, ETL pipelinesCloud Platform: AWS (S3, Glue, Lambda, EMR, Redshift, Athena)Data...

  • Pyspark,sql & aws glue Professional

    3 days ago

    Hyderabad, Telangana, India IDESLABS PRIVATE LIMITED Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Looking to onboard a skilled professional with 6-8 years of experience in Pyspark, SQL, and AWS Glue. The ideal candidate will have a strong background in these technologies and excellent problem-solving skills. This position is located across Pan India.Roles and ResponsibilityDesign, develop, and implement data processing pipelines using Pyspark and AWS...

  • Python Pyspark AWS DBT

    15 hours ago

    Hyderabad, Telangana, India Virtusa Full time ₹ 1,20,000 - ₹ 6,00,000 per year

    Job Summary:We are looking for a skilled AWS Data Engineer with strong experience in building and managing cloud-based ETL pipelines using AWS Glue, Python/PySpark, and Athena, along with data warehousing expertise in Amazon Redshift. The ideal candidate will be responsible for designing, developing, and maintaining scalable data solutions in a cloud-native...

  • Data Engineering

    2 weeks ago

    Hyderabad, Telangana, India Selectify Analytics Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job description:Expert knowledge in AWS Data Lake implementation and support (S3, Glue,DMS Athena, Lambda, API Gateway, Redshift)Handling of data related activities such as data parsing, cleansing quality definition data pipelines, storage and ETL scriptsExperiences in programming language Python/Pyspark/SQLExperience with data  migration with hands-on...

  • Data Engineer

    3 days ago

    Hyderabad, Telangana, India Zorba AI Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Key Skills Required-Minimum experience required 3 years in Data Engineer (Python,Pyspark, AWS, SQL)Programming & Frameworks: Python, PySparkDatabases & Querying: Strong SQL (query optimization, joins, window functions)Big Data & Processing: PySpark for distributed data processing, ETL pipelinesCloud Platform: AWS (S3, Glue, Lambda, EMR, Redshift, Athena)Data...

  • AWS Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Zorba AI Full time ₹ 1,00,00,000 - ₹ 2,50,00,000 per year

    Senior AWS Data Engineer (PySpark & Python) — On-site, IndiaIndustry & Sector:Leading IT services & cloud data engineering sector focused on end-to-end data platforms, analytics, and enterprise-scale ETL/ELT solutions. We deliver production-grade data pipelines, real-time streaming, and analytics integrations for large enterprise customers across finance,...

  • Data Engineer

    1 week ago

    Hyderabad, Telangana, India Selectify Analytics Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Company DescriptionSelectify Analytics empowers businesses to unlock the true value of data through AI-powered solutions. As a certified AWS Partner, we offer comprehensive services in Data Engineering, AI/ML, Generative AI, BI & Reporting, and DevOps. Our mission is to help organizations harness data and AI to drive innovation, optimize operations, and...

  • MLOps/AWS Data Engineer

    1 day ago

    Hyderabad, Telangana, India People Prime Worldwide Pvt. Ltd. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Key Responsibilities : - Design, build, and maintain scalable MLOps pipelines using AWS tools such as SageMaker, Lambda, Step Functions, and CodePipeline. - Automate ML workflows including data preprocessing, model training, validation, deployment, and monitoring. - Integrate CI/CD pipelines for ML models using AWS CodeBuild, CodeDeploy, or GitHub...

  • Data Engineer

    19 hours ago

    Hyderabad, Telangana, India Zensar Technologies Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Immediate JoinerLooking for Data engineer with Pyspark & AWS SkillsJD as provided below• 5+ years of overall IT experience, which includes hands on experience in Big Data technologies.• Mandatory - Hands on experience in Python and PySpark.• Build pySpark applications using Spark Dataframes in Python.• Worked on optimizing spark jobs that processes...

  • Lead Data Engineer

    7 days ago

    Hyderabad, Telangana, India Zorba AI Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Primary Job Title:Data Engineering LeadAbout The OpportunityWe are seeking a highly skilledLead Data Engineerwith strong expertise inPython, Pandas, PySpark, AWS, and SQLto design, build, and manage scalable data solutions. The ideal candidate will lead a team of data engineers, develop robust ETL pipelines, and collaborate with analytics, data science, and...