DataBricks / AWS Redshift

6 days ago

Chennai, Tamil Nadu, India Virtusa Full time ₹ 15,00,000 - ₹ 25,00,000 per year

Key responsibilities include designing developing and maintaining scalable data pipelines using Apache Spark on Databricks Writing efficient and production ready PySpark or Scala code for data transformation and ETL processes Integrating data from various structured and unstructured sources into a unified platform Implementing Delta Lake and managing data versioning updates and schema evolution Optimizing data processing workflows for performance scalability and cost efficiency Collaborating with data scientists analysts and business stakeholders to deliver high quality datasets Implementing data quality checks validation routines and logging mechanisms Monitoring and debugging production jobs using Databricks jobs notebooks and clusters Ensuring security privacy and compliance standards are met throughout the data lifecycle Providing guidance and mentorship to junior team members Required skills and qualifications include four to six years of experience in Big Data development Hands on experience with Databricks including Workflows Notebooks Delta Live Tables and Unity Catalog Strong programming skills in PySpark and or Scala Solid understanding of Delta Lake architecture Proficiency in SQL for data analysis and transformation Experience with cloud platforms such as Azure including Azure Data Lake Data Factory and Synapse or AWS including S3 Glue and Redshift Familiarity with CI and CD for Databricks deployments such as using GitHub Actions or Azure DevOps Knowledge of data governance cataloguing and security best practices Experience working in an Agile or Scrum environment Required skills include Databricks Redshift and SQL Preferred skills include Python and Snowflake Additional preferred experience includes working with Databricks Unity Catalog and Delta Live Tables exposure to machine learning workflows in Databricks and experience with orchestration or messaging tools such as Apache Airflow or Kafka Certifications such as Databricks Certified Data Engineer Associate or Professional Azure or AWS certification are also desirable

About Virtusa

Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 27,000 people globally that cares about your growth — one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.

Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.

Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.

  • Senior Data Engineer – AWS RedShift

    6 days ago

    Chennai, Tamil Nadu, India Systech Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Senior Data Engineer – AWS RedShiftAbout the CompanySystech is a modern Data and Analytics consulting firm, helping clients embed data-driven capabilities into their business operations. We offer end-to-end data engineering services and outcomes-based analytics solutions, to drive your business forward in the digital age. Systech has over 30 years of...

  • Lead Data Engineer – AWS RedShift

    5 days ago

    Chennai, Tamil Nadu, India Systech Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Lead Data Engineer – AWS RedShiftAbout the CompanySystech is a modern Data and Analytics consulting firm, helping clients embed data-driven capabilities into their business operations. We offer end-to-end data engineering services and outcomes-based analytics solutions, to drive your business forward in the digital age. Systech has over 30 years of...

  • AWS Data engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Virtusa Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    AWS Data EngineerDesign and build scalable data pipelines using AWS services like AWS Glue, Amazon Redshift, and S3.Develop efficient ETL processes for data extraction, transformation, and loading into data warehouses and lakes.Create and manage applications using Python, SQL, Databricks, and various AWS technologies.Automate repetitive tasks and build...

  • AWS Data Engineer with Redshift

    2 weeks ago

    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: - AWS Data Engineer with RedshiftLocation: - ChennaiJob Type 3 days from office (Hybrid)Minimum 6 to 13 years of experienceTeam management and client handling skills, including SLA tracking and job failure resolutionExcellent knowledge in Cloud technologies, especially AWSStrong in AWS Data Engineering pipelines, SQL, Python and DWHLiaise with...

  • AWS Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India MyCareernet Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Company:IT Services OrganizationKey Skills:AWS, Pyspark, Databricks, SQL, Python, ETL, Azure Databricks, Data modeling, Data Warehouse, Data Engineer, Data Engineering, PL/SQL, Data ModellingRoles and Responsibilities:Design, develop, and maintain ETL processes to support data integration and transformation.Utilize Python for data engineering tasks, ensuring...

  • Senior AWS Data Engineer

    2 days ago

    Chennai, Tamil Nadu, India Innovatz Global Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Company DescriptionInnovatz Global is a leading Management Consulting and Technology Services company with headquarters in Malaysia and a strong presence across multiple countries, including the U.S., India, China, and Australia. With over 500 skilled professionals, the company specializes in delivering innovative IT solutions and staffing services to...

  • AWS Data Engineer

    5 days ago

    Chennai, Tamil Nadu, India ResourceTree Global Services Pvt Ltd Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Years of experience - 4 to 10 yearsJob Description: We are seeking a highly skilled and motivated Lead/Senior Data Engineer to join our Data Integration and Analytics team. The ideal candidate will bring deep expertise in AWS Redshift, with strong knowledge of Redshift architecture, query performance tuning, and workload optimization. You will be responsible...

  • AWS + Pyspark

    6 days ago

    Chennai, Tamil Nadu, India Cognizant Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Skills- AWS +PysparkExperience: 4 to 9 yearsLocation: AIA-PuneAs an AWS Data Engineer, you will design, build, and manage robust data pipelines on the AWS cloud platform. You will leverage your expertise in AWS data services and programming languages to ingest, process, transform, and store data efficiently, enabling data-driven insights and...

  • Senior Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India DB Consultancy Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Design and develop scalable data engineering solutions. Build and maintain ETL (Extract, Transform, Load) pipelines. Implement data warehousing solutions. Utilize Databricks, PySpark, and AWS services. Required Candidate profileContribute to the adoption of DevOps and Agile practices. Core Competencies:- SQL- Databricks- PySpark- Python- Pandas and...

  • AWS Infra Dev

    2 weeks ago

    Chennai, Tamil Nadu, India Virtusa Full time ₹ 4,00,000 - ₹ 6,00,000 per year

    P2-C3-STSAWS CDK with Type Script, Cloud formation template.AWS services like Redshift Executing Grants, Store Procedures, Queries, Redshift Spectrum to Query S3, Glue Execution Roles, JOB Debugging, IAM roles Creation with Fine Grained access, Integration & Deployment, KMS keys CMK and DEK, Secrets Manager, Airflow DAG Creation & Execution, SFTP, AWS Lambda...