Python Pyspark AWS DBT

14 hours ago

Hyderabad, Telangana, India Virtusa Full time ₹ 1,20,000 - ₹ 6,00,000 per year

Job Summary:We are looking for a skilled AWS Data Engineer with strong experience in building and managing cloud-based ETL pipelines using AWS Glue, Python/PySpark, and Athena, along with data warehousing expertise in Amazon Redshift. The ideal candidate will be responsible for designing, developing, and maintaining scalable data solutions in a cloud-native environment.Design and implement ETL workflows using AWS Glue, Python, and PySpark.Develop and optimize queries using Amazon Athena and Redshift.Build scalable data pipelines to ingest, transform, and load data from various sources.Ensure data quality, integrity, and security across AWS services.Collaborate with data analysts, data scientists, and business stakeholders to deliver data solutions.Monitor and troubleshoot ETL jobs and cloud infrastructure performance.Automate data workflows and integrate with CI/CD pipelines.Required Skills & Qualifications:Hands-on experience with AWS Glue, Athena, and Redshift.Strong programming skills in Python and PySpark.Experience with ETL design, implementation, and optimization.Familiarity with S3, Lambda, CloudWatch, and other AWS services.Understanding of data warehousing concepts and performance tuning in Redshift.Experience with schema design, partitioning, and query optimization in Athena.Proficiency in version control (Git) and agile development practices.

  • Snowflake DBT AWS

    3 days ago

    Hyderabad, Telangana, India IDESLABS PRIVATE LIMITED Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Primary Skills -Snowflake, DBT, AWS;Good to have Skills - Fivetran (HVR), Python Responsibilities: Design, develop, and maintain data pipelines usingSnowflake, DBT, and AWS.Collaborate with cross-functional teams to understand data requirements and deliver solutions.Optimize and troubleshoot existing data workflows to ensure efficiency and...

  • Date Engineer(Python, Pyspark and AWS)

    1 week ago

    Hyderabad, Telangana, India Zorba AI Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Key Skills Required-Minimum 6 years of working experience in Python, Pyspark, AWS and SQL.Programming & Frameworks: Python, PySparkDatabases & Querying: Strong SQL (query optimization, joins, window functions)Big Data & Processing: PySpark for distributed data processing, ETL pipelinesCloud Platform: AWS (S3, Glue, Lambda, EMR, Redshift, Athena)Data...

  • Python And PySpark Developer

    1 week ago

    Hyderabad, Telangana, India Nisum Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Company DescriptionNisum is a global consulting partner specializing in digital commerce and evolution, offering AI-powered platforms and tailor-made solutions to unlock growth, optimize operations, and create long-term value. With over 25 years of proven experience, Nisum has a consistent track record of delivering complex digital transformations for...

  • Python ( Airflow / DBT ) Engineer

    5 days ago

    Hyderabad, Telangana, India Luxoft Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Project descriptionThis project is part of a strategic initiative to migrate legacy on-premises data systems to a modern, scalable cloud-based data platform using Snowflake on Azure. The goal is to enhance data accessibility, performance, and governance while enabling advanced analytics and automation.The resource will join an ongoing effort to accelerate...

  • Python Developer with Pyspark

    2 days ago

    Hyderabad, Telangana, India Datamaxis Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Python Developer with PysparkHyderabadRole - FulltimeAvailability to Join - ImmediateYears of experience - 5+Required skills and qualifications5+ years of experience as a Python Developer with a strong portfolio of projects.Experience working in Pyspark is mustBachelor's degree in Computer Science, Software Engineering or a related field.In-depth...

  • Sr. Data Engineer – AWS Databricks

    2 weeks ago

    Hyderabad, Telangana, India Gravity Infosolutions, Inc. Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Sr. Data Engineer – AWS Databricks / Data Tech LeadType: ContractLocation : Chennai / HydExperience: 5+ yearsDuration: 3 Months+ ExtendableKey ResponsibilitiesData Pipeline Development: Design and implement robust ETL/ELT pipelines using Databricks, PySpark, and Delta Lake to process structured and unstructured data efficiently.Manage job orchestration,...

  • Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Valuelabs Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Primary Skillset: Python, SQL, Spark Pyspark, Datawarehouse, Azure, Snowflake, DBT, Airflow, HadoopSecondary Skillset: Scala, AWS, Databricks.

  • Data Engineer – AWS Glue, Redshift,, PySpark

    3 days ago

    Hyderabad, Telangana, India Cyepro Solutions Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Company Overview:Cyepro Solutions is at the forefront of innovation in customer relationship management, specializing in the automotive industry. We offer a platform that empowers dealerships, manufacturers, and service providers to enhance customer experiences and streamline operations. Headquartered in Hyderabad, Telangana, with a team of employees, Cyepro...

  • DBT Developer

    2 weeks ago

    Hyderabad, Telangana, India Zillion Technologies Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Job Title: DBT DeveloperSkillset required: Design, Develop, Document, Test and ImplementLocations can be Hyderabad, Chennai, KolkataMust-Have Skills: DBT and SnowflakeGood-to-Have skills: Informatica PowerCenterExperience & Skills:Experience in data engineering, specifically with Snowflake and DBT.Key skills required are strong hands-on experience with...

  • Pyspark,sql & aws glue Professional

    2 days ago

    Hyderabad, Telangana, India IDESLABS PRIVATE LIMITED Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Looking to onboard a skilled professional with 6-8 years of experience in Pyspark, SQL, and AWS Glue. The ideal candidate will have a strong background in these technologies and excellent problem-solving skills. This position is located across Pan India.Roles and ResponsibilityDesign, develop, and implement data processing pipelines using Pyspark and AWS...