Sr. Data Engineer – AWS Databricks

5 hours ago

Kozhikode, India Gravity Infosolutions, Inc. Full time

Role: Sr. Data Engineer – AWS Databricks / Data Tech LeadType: ContractLocation: Chennai / HyderabadExperience: 5+ yearsDuration: 3 Months+ ExtendableKey Responsibilities:Data Pipeline Development: Design and implement robust ETL/ELT pipelines using Databricks, PySpark, and Delta Lake to process structured and unstructured data efficiently.Manage job orchestration, scheduling, and workflow automation through Databricks Workflows or Airflow.Performance Optimization: Tune and optimize Databricks clusters and notebooks for performance, scalability, and cost-efficiency.Data Governance: Implement data governance and lineage using Unity Catalog and other platform-native featuresCollaboration: Work closely with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions that meet business needs.Cloud Integration: Leverage cloud platforms (AWS) to build and deploy data solutions, ensuring seamless integration with existing infrastructure.Data Modeling: Develop and maintain data models that support analytics and machine learning workflows.Automation & Monitoring: Implement automated testing, monitoring, and alerting mechanisms to ensure data pipeline reliability and data quality.Documentation & Best Practices: Maintain comprehensive documentation of data workflows and adhere to best practices in coding, version control, and data governance.Required Qualifications:Experience: 5+ years in data engineering, with hands-on experience using Databricks and Apache Spark.Programming Skills: Proficiency in Python and SQL;Cloud Platforms: Strong experience with cloud services such as AWS (e.g., S3, Glue, RedshiftData Engineering Tools: Familiarity with tools like Airflow, Kafka, and dbt.Data Modeling: Experience in designing data models for analytics and machine learning applications.Collaboration: Proven ability to work in cross-functional teams and communicate effectively with non-technical stakeholders.Primary Skill Set:Databricks, Apache Spark/Pyspark, Python, SQL, ETL/ELT development, Delta Lake, Cloud platforms (AWS), Data modeling, Cross-functional collaboration, CommunicationSecondary Skill Set:Airflow, dbt, Kafka, Hadoop, MLflow, Unity Catalog, Delta Live Tables, Cluster optimization, Data governance, Security and compliance, Databricks certifications.

  • Opening For Aws Lead

    3 days ago

    Kozhikode, India Whatjobs IN C2 Full time

    You will participate in the design, development, and deployment of scalable and robust applications using AWS CloudFront, S3 buckets, Node.Js, TypeScript, React.Js, Next.Js, Stencil.Js, and Aurora Postgres SQL. Implement microservices that integrate with Databricks as a Data Lake and consume data products. Key Responsibilities: Collaborate closely with other...

  • Senior Software Engineer

    1 week ago

    Kozhikode, India Sky Systems, Inc. (SkySys) Full time

    Role: Sr. Software Engineer I Position Type: Full-Time Contract (40hrs/week)Contract Duration: Long Term (Contract to hire)Work Schedule: 8 hours/day (Mon-Fri)Location: Hybrid (2 days onsite in Bangalore or Chennai)We’re seeking a skilled Sr. Software Engineer with strong expertise in AWS DevOps, Java, and MuleSoft. The ideal candidate will have hands-on...

  • ▷ Apply Now! Sr. Data Architect

    1 day ago

    Kozhikode, India Qode Full time

    Sr. Data Architect Experience: 10+ years Notice period : Immediate Location :Trivandrum / Kochi Job Description A minimum of 10 years of experience in data engineering, encompassing the development and scaling of data warehouse and data lake platforms. The candidate should possess a strong background in Snowflake, demonstrating leadership in technical...

  • Sr. Data Architect

    1 week ago

    Kozhikode, India Reflections Info Systems Full time

    We are looking for 10+ years experienced Sr. Data ArchitectA minimum of 10 years of experience in data engineering, encompassing the development and scaling of data warehouse and data lake platforms.The candidate should possess a strong background in both Snowflake and SAP BW/ECC environments, demonstrating leadership in technical design, architecture, and...

  • Sr. Cloud Engineer

    2 days ago

    Kozhikode, Kerala, India Techbrein Solutions Pvt Ltd Full time ₹ 10,00,000 - ₹ 30,00,000 per year

    Position: Sr. Cloud EngineerExperience: 2+ yearsLocation: CalicutAWS, Azure, or Google Cloud: Deep understanding and hands-on experience with one or more majorcloud platforms.Cloud Services: Proficiency with core cloud services such as compute (EC2, VMs), storage (S3, Blob,Cloud Storage), databases (RDS, Azure SQL, BigQuery), networking (VPC, VNets, Cloud...

  • Senior Data Engineer

    2 weeks ago

    Kozhikode, India The Mastermind Group Full time

    Senior Data Engineer Location: Remote (India) – Occasional travel to Riyadh, KSAContract Type: 12-Month ContractWork Week: Sunday–Thursday preferred (9 AM – 5 PM IST)Start Date: As soon as possibleAbout The Mastermind Group (TMG)TMG is a global leader in IT Spend Optimisation, helping enterprises take control of their tech investments across software,...

  • Lead Sr Software Engineer Python

    3 days ago

    Kozhikode, India Whatjobs IN C2 Full time

    Position - Lead Sr Software Engineer - Python & React Exp -7-10 yrs Work Mode- Remote Responsibilities & Skills:- ● Have 7+ years of industry experience delivering Enterprise products with 3 years in a senior engineer position. ● Have experience in building or scaling platforms, APIs, or enterprise-grade SaaS products using Python, React. ● Have...

  • Sr Associate

    4 days ago

    Kozhikode, Kerala, India Tass & Hamjit Financial Advisory Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Elevate Your Career with Tass & HamjitLocation : Calicut, Kerala.We're looking for a Senior Associate - Advisory to join our team in the GCC Back Office.If you're a qualified accounting professional with 3-5 years of experience and a passion for advisory services,we want to hear from youKey Requirements:ACCA Affiliate, CMA India Qualified, or CA Qualified3-5...

  • Data Engineer

    3 days ago

    Kozhikode, India Whatjobs IN C2 Full time

    Key Responsibilities Design, develop, and maintain ETL/ELT pipelines to process structured and unstructured data. Build and optimize data lakes and data warehouses using AWS services (e.G., S3, Glue, Redshift, EMR, Lambda). Develop automation scripts and tools using Python for data integration, validation, and transformation. Collaborate with data analysts,...

  • AWS Cloud Engineer

    1 week ago

    Kozhikode, India Techfully Full time

    Experience 3-5yrswork type: RemoteAdvanced / Cloud Ops & Architecture Skills (Optional but Valuable)Area Tools / Skills DescriptionContainers & Orchestration ECS, EKS, Docker Manage microservices-based deploymentsServerless Management Lambda, API Gateway Optimize cost and performance using event-driven designDatabases RDS, DynamoDB, Aurora Database setup,...