Principal AWS Data Engineer

14 hours ago

Surat, India K&K Global Talent Solutions INC. Full time

K&K Global Talent is an international recruiting agency that has been providing technical resources globally since 1993. This position is with one of our clients in India , who is actively hiring candidates to expand their teams.Title: Principal AWS Data EngineerLocation: Bhopal, Bangalore, Chennai, Gurgaon, Hyderabad, Jaipur, Pune (Hybrid)Employment Type: Full-time PermanentNotice Period: Immediate to 1 MonthRequired Skills: DBT, DataBricks, AWS, Python, Pyspark, SQLExperience Required: 10+ YearsRole & Responsibilites:As a Principal Data Engineer in the Data Warehouse team you will be relied on to lead a team of Sr. Data Engineers, propose Architecture, solve complex situations and data model, interact directly with client for requirement gathering, build a holistic roadmap, identify risks and have mitigation strategy, develop and deliver high-quality features and finish tasks to a high standard. You’ll be part of an emerging team, focussing on building and improving Data Warehouse offerings applying marketing suites.Required Skills:For this position the ideal candidate should have 10+ years of experience in software development, and with data structures/algorithms with a focus on backend and data engineering.● Overall 10 + years of experience in data engineering with 4+ years leading team● 8+ years of hands-on experience in using Python, JVM and Shell Scripting with production experience.● 5+ years of proven experience on building cloud native data intensive applications, Amazon Web Service experience is a must.● Experience on Data Warehouse design and development per the business nature using any of the modern data warehouses● Strong experience in Databricks and DBT experience is required● Highly proficient in architecting and implementing workflow management systems, Airflow is a must.● Hands-on experience of building and maintaining Spark applications.● Fundamental understanding of Parquet, Delta Lake and other OTFs file formats.● Strong experience on building CI/CD processes, experience with GitHub Actions, ArgoCD or Jenkins● Experience with unit testing and test automation frameworks.● Propose and review Architecture● Solve complex situations and data modelPrefered Skills:● Familiarity with containerization and orchestration technologies (e.g., Docker, Kubernetes)● Familiarity on an IaC tool such as Terraform, CDK or CloudFormation is a must● Experience with observability systems (such as Datadog or Prometheus/Grafana)Soft skills:● Lead a team of 4-5 Sr.Engg● Client communication and Requirement gathering● Build a holistic Tech roadmap for DWH (collaborate with business + teach leads)● Identify risks and have mitigation strategy● Mentoring Junior team members● Guiding and revieing PR. Guide on best practices● Learning aptitude: Ready to upskill on new tech stacks / skills● Comfortable providing, receiving constructive feedback, particularly while participating in code reviews and ability to not only code, but also provide good quality readable business documentation.● Focus on business value vs engineering interest and focus on business value vs engineering interest.● Pro-active / service-oriented towards our internal customers

  • AWS Data Engineer

    4 weeks ago

    Surat, India COVET IT INC Full time

    Hi,Please go through the below requirements and let me know your interest and forward your resume along with your contact information to : AWS Data EngineerLocation : 100% Remote.Job Description:We are seeking a highly skilled AWS Data Engineer to design, build, and optimize scalable data pipelines and analytical solutions. The ideal candidate will have...

  • Freelance – AWS Data

    2 weeks ago

    Surat, India ThreatXIntel Full time

    Company DescriptionThreatXIntel is a dynamic startup specialized in cyber security, providing innovative and affordable solutions to protect businesses and organizations from various cyber threats. Our team offers services such as cloud security, web and mobile security testing, DevSecOps, and more, tailored to meet the unique needs of clients. Committed to...

  • Data Engineering Leader

    2 weeks ago

    surat, India beBeeData Full time

    Job OverviewAs a seasoned Lead Data Engineer, you will spearhead the design and development of a cutting-edge data warehouse on AWS.This role is instrumental in building a scalable, secure, and efficient data platform that supports analytics, reporting, and AI use cases across the organization.The ideal candidate should be both technically proficient and...

  • AWS DevOps Engineer

    2 weeks ago

    Surat, Gujarat, India Aviansoft Pvt Ltd Full time ₹ 4,80,000 per year

    Devops EngineerLocation : SuratJob SummaryAs a DevOps Engineer, you will bridge the gap between software development and IT operations, enabling faster, reliable, and automated delivery of applications. You will work with cross-functional teams to enhance system performance, scalability, and security.Key ResponsibilitiesDesign, implement, and maintain CI/CD...

  • Data Engineer

    4 days ago

    Surat, India Tata Consultancy Services Full time

    TCS is hiring for Data Engineer (Data brick) role!!!Experience: 4 to 12 yearsLocation: Kolkata, AhmedabadSkills: Databricks, Spark and Data Migration experienceJob Summary:Strong Databricks, Spark and Data Migration experienceShould have experience of end-to-end migration from AWS Redshift or other RDS to Databricks Lakehouse Platform. Need to have knowledge...

  • Data Engineer

    4 days ago

    Surat, India Tata Consultancy Services Full time

    TCS is hiring for Data Engineer (Data brick) role!!!Experience: 4 to 12 yearsLocation: Kolkata, AhmedabadSkills: Databricks, Spark and Data Migration experienceJob Summary:Strong Databricks, Spark and Data Migration experienceShould have experience of end-to-end migration from AWS Redshift or other RDS to Databricks Lakehouse Platform. Need to have knowledge...

  • Senior Data Strategy Leader

    2 weeks ago

    surat, India beBeeData Full time

    Job Title: Senior Data Architect - SnowflakeWe are seeking a distinguished Principal Snowflake Architect to act as a Trusted Advisor and Global Evangelist for our data practice, focusing specifically on the Banking, Financial Services, and Insurance (BFSI) sector.Job Description: Solution Articulation: Serve as the lead technical consultant, translating...

  • AWS Glue

    4 weeks ago

    Surat, India HCLTech Full time

    Key Responsibilities• Develop and maintain data models and transformations using DBT.• Load and manage data in Snowflake, including staging and curated layers.• Implement data ingestion processes from various sources using AWS services (Glue, S3, DMS).• Apply business logic to transform data and build facts and dimensions as per requirements.•...

  • AWS Glue

    4 weeks ago

    Surat, India HCLTech Full time

    Key Responsibilities• Develop and maintain data models and transformations using DBT.• Load and manage data in Snowflake, including staging and curated layers.• Implement data ingestion processes from various sources using AWS services (Glue, S3, DMS).• Apply business logic to transform data and build facts and dimensions as per requirements.•...

  • Data Scientist

    2 weeks ago

    Surat, Gujarat, India Blue Data Consulting Full time

    **Data Scientist** **Key Responsibilities**: - Develop and implement NLP solutions for text analysis, sentiment analysis, and language understanding. - Utilize Python programming for data manipulation, model building, and data visualization tasks. - Collaborate with cross-functional teams to integrate data science solutions into cloud environments,...