Sr. Data Engineer – AWS Databricks

3 weeks ago

Kozhikode, India Gravity Infosolutions, Inc. Full time

Role: Sr. Data Engineer – AWS Databricks / Data Tech LeadType: ContractLocation: Chennai / HyderabadExperience: 5+ yearsDuration: 3 Months+ ExtendableKey Responsibilities:Data Pipeline Development: Design and implement robust ETL/ELT pipelines using Databricks, PySpark, and Delta Lake to process structured and unstructured data efficiently.Manage job orchestration, scheduling, and workflow automation through Databricks Workflows or Airflow.Performance Optimization: Tune and optimize Databricks clusters and notebooks for performance, scalability, and cost-efficiency.Data Governance: Implement data governance and lineage using Unity Catalog and other platform-native featuresCollaboration: Work closely with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions that meet business needs.Cloud Integration: Leverage cloud platforms (AWS) to build and deploy data solutions, ensuring seamless integration with existing infrastructure.Data Modeling: Develop and maintain data models that support analytics and machine learning workflows.Automation & Monitoring: Implement automated testing, monitoring, and alerting mechanisms to ensure data pipeline reliability and data quality.Documentation & Best Practices: Maintain comprehensive documentation of data workflows and adhere to best practices in coding, version control, and data governance.Required Qualifications:Experience: 5+ years in data engineering, with hands-on experience using Databricks and Apache Spark.Programming Skills: Proficiency in Python and SQL;Cloud Platforms: Strong experience with cloud services such as AWS (e.g., S3, Glue, RedshiftData Engineering Tools: Familiarity with tools like Airflow, Kafka, and dbt.Data Modeling: Experience in designing data models for analytics and machine learning applications.Collaboration: Proven ability to work in cross-functional teams and communicate effectively with non-technical stakeholders.Primary Skill Set:Databricks, Apache Spark/Pyspark, Python, SQL, ETL/ELT development, Delta Lake, Cloud platforms (AWS), Data modeling, Cross-functional collaboration, CommunicationSecondary Skill Set:Airflow, dbt, Kafka, Hadoop, MLflow, Unity Catalog, Delta Live Tables, Cluster optimization, Data governance, Security and compliance, Databricks certifications.

  • Opening For Aws Lead

    3 weeks ago

    Kozhikode, India Whatjobs IN C2 Full time

    You will participate in the design, development, and deployment of scalable and robust applications using AWS CloudFront, S3 buckets, Node.Js, TypeScript, React.Js, Next.Js, Stencil.Js, and Aurora Postgres SQL. Implement microservices that integrate with Databricks as a Data Lake and consume data products. Key Responsibilities: Collaborate closely with other...

  • Senior Data Engineer

    3 weeks ago

    Kozhikode, India Whatjobs IN C2 Full time

    About the role: We are looking for a strong Data Architect to join our engineering team, focusing on leveraging Azure SQL, Cosmos DB and DataBricks to meet our growing data demands. As a Data Leader in the Apex organization, you will own, develop, and oversee the data capabilities powering customer-facing applications used by hundredsof thousands of...

  • ▷ Apply Now! Sr. Data Architect

    3 weeks ago

    Kozhikode, India Qode Full time

    Sr. Data Architect Experience: 10+ years Notice period : Immediate Location :Trivandrum / Kochi Job Description A minimum of 10 years of experience in data engineering, encompassing the development and scaling of data warehouse and data lake platforms. The candidate should possess a strong background in Snowflake, demonstrating leadership in technical...

  • Azure Data Engineer

    2 days ago

    Kozhikode, India Whatjobs IN C2 Full time

    Greetings From TCS! Azure Senior Data Engineers 5 to 10 years PAN INDIA Interview Date: Weekend Virtual Drive 15-Nov-25 Last Date of form submission: Today/ASAP Extensive coding experience (3+ years) including Python/Pyspark (1 years +) Experience developing in Azure with key data technologies (e.G. ADLS, ADF, Azure Databricks etc.) Software development...

  • Sr. Cloud Engineer

    2 weeks ago

    Kozhikode, Kerala, India Techbrein Solutions Pvt Ltd Full time ₹ 3,00,000 - ₹ 4,20,000 per year

    Position: Sr. Cloud EngineerExperience: 2+ yearsLocation: CalicutAWS, Azure, or Google Cloud: Deep understanding and hands-on experience with one or more majorcloud platforms.Cloud Services: Proficiency with core cloud services such as compute (EC2, VMs), storage (S3, Blob,Cloud Storage), databases (RDS, Azure SQL, BigQuery), networking (VPC, VNets, Cloud...

  • Senior Data Engineer

    3 weeks ago

    Kozhikode, India Whatjobs IN C2 Full time

    Profile name- Senior Data Infrastructure Engineer - Apache Spark & Kubernetes Experience - 5 Years Mode- Remote Required Qualifications - Minimum 5 years of experience in Data Engineering or Infrastructure roles. - Proven hands-on experience with Apache Spark in production. - Deep expertise in Kubernetes architecture and operations. - Strong experience with...

  • Engineer

    1 week ago

    Kozhikode, India Tata Consultancy Services Full time

    TCS has been a great pioneer in feeding the fire of Young techies like you. We are global leaders in the technology arena and there's nothing that can stop us from growing together. TCS Hiring for skill " AI/ML". Role: Engineer Required Technical Skill Set: AI/ML Experience: 5 to 10 Yrs Work Location: Hyd, Noida, Chennai, Mumbai Desired Competencies:...

  • Lead Sr Software Engineer Python

    3 weeks ago

    Kozhikode, India Whatjobs IN C2 Full time

    Position - Lead Sr Software Engineer - Python & React Exp -7-10 yrs Work Mode- Remote Responsibilities & Skills:- ● Have 7+ years of industry experience delivering Enterprise products with 3 years in a senior engineer position. ● Have experience in building or scaling platforms, APIs, or enterprise-grade SaaS products using Python, React. ● Have...

  • Data Engineer

    3 weeks ago

    Kozhikode, India Whatjobs IN C2 Full time

    Key Responsibilities Design, develop, and maintain ETL/ELT pipelines to process structured and unstructured data. Build and optimize data lakes and data warehouses using AWS services (e.G., S3, Glue, Redshift, EMR, Lambda). Develop automation scripts and tools using Python for data integration, validation, and transformation. Collaborate with data analysts,...

  • Engineering Manager

    1 week ago

    Kozhikode, India Tamara Full time

    🚀 Data Engineering Manager II: Real-Time Data & Experimentation Platform (Remote, India)About TamaraTamara is Saudi Arabia's first fintech unicorn 🦄 and the leading financial super-app in the GCC, with a mission to empower dreams through customer-centric financial solutions. We partner with giants like SHEIN, IKEA, Amazon, and Jarir, serving millions...