Sr. Data Engineer – AWS Databricks

4 weeks ago

bangalore, India Gravity Infosolutions, Inc. Full time

Sr. Data Engineer – AWS Databricks / Data Tech Lead Type: Contract Location : Chennai / Hyd Experience: 5+ years Duration: 3 Months+ Extendable Key Responsibilities Data Pipeline Development: Design and implement robust ETL/ELT pipelines using Databricks, PySpark, and Delta Lake to process structured and unstructured data efficiently. Manage job orchestration, scheduling, and workflow automation through Databricks Workflows or Airflow . Performance Optimization: Tune and optimize Databricks clusters and notebooks for performance, scalability, and cost-efficiency. Data Governance: Implement data governance and lineage using Unity Catalog and other platform-native features Collaboration: Work closely with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions that meet business needs. Cloud Integration: Leverage cloud platforms (AWS) to build and deploy data solutions, ensuring seamless integration with existing infrastructure. Data Modeling: Develop and maintain data models that support analytics and machine learning workflows. Automation & Monitoring: Implement automated testing, monitoring, and alerting mechanisms to ensure data pipeline reliability and data quality. Documentation & Best Practices: Maintain comprehensive documentation of data workflows and adhere to best practices in coding, version control, and data governance. Required Qualifications Experience: 5+ years in data engineering, with hands-on experience using Databricks and Apache Spark. Programming Skills: Proficiency in Python and SQL; Cloud Platforms: Strong experience with cloud services such as AWS (e.g., S3, Glue, Redshift Data Engineering Tools: Familiarity with tools like Airflow, Kafka, and dbt. Data Modeling: Experience in designing data models for analytics and machine learning applications. Collaboration: Proven ability to work in cross-functional teams and communicate effectively with non-technical stakeholders. Primary Skill Set Databricks, Apache Spark/Pyspark, Python, SQL, ETL/ELT development, Delta Lake, Cloud platforms (AWS), Data modeling, Cross-functional collaboration, Communication Secondary Skill Set Airflow, dbt, Kafka, Hadoop, MLflow, Unity Catalog, Delta Live Tables, Cluster optimization, Data governance, Security and compliance, Databricks certifications

  • Sr. Data Engineer – AWS Databricks

    4 weeks ago

    bangalore, India Gravity Infosolutions, Inc. Full time

    Role: Sr. Data Engineer – AWS Databricks / Data Tech Lead Type: Contract Location: Chennai / Hyderabad Experience: 5+ years Duration: 3 Months+ Extendable Key Responsibilities: Data Pipeline Development: Design and implement robust ETL/ELT pipelines using Databricks, PySpark, and Delta Lake to process structured and unstructured data efficiently. Manage...

  • Aws Databricks Engineer

    3 days ago

    bangalore, India People Prime Worldwide Full time

    Job Title: AWS Data engineerLocation: PAN India (Hybrid)Experience: 5–12 Years (STRICTLY)Employment Type: PermanentNotice Period: Immediate Joiners / ≤ 30 Days OnlyCTC:[5–8 yrs] – Up to 21 LPA[8–12 yrs] – Up to 26 LPAAbout the CompanyOur client is a global leader in digital transformation and IT services across 50+ countries. They specialize in...

  • Senior Data Engineer

    2 weeks ago

    Bangalore Division, India Accolade Full time

    About Accolade The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront. We are building the industry's first AI-native Operations Centralization Platform, designed to streamline complex processes, unlock new efficiencies, and create better experiences for residents and operators alike. Our platform uses...

  • Sr. Data Engineer

    3 weeks ago

    bangalore, India xponent.ai Full time

    We are an Australian Data and AI company and are expanding our Databricks Capability in India and are seeking a Senior Databricks Data Engineer to build scalable, production-grade data platforms that enable AI and advanced analytics for our global clients. We are open, transparent, no-nonsense, innovative problem solvers and eternal learners as a team where...

  • Senior Software Engineer

    1 week ago

    bangalore, India Databricks Full time

    P-1346At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...

  • Data Engineer with Databricks Expertise

    1 week ago

    bangalore, India Hello World Tech Consulting Full time

    Job SummaryWe are seeking a highly skilled Data Engineer with Databricks certifications andextensive practical experience working with the Databricks Lakehouse platform and itssupporting capabilities. The ideal candidate will possess a robust understanding of AWSservices relevant to data engineering and demonstrate proficiency in data pipelinedevelopment,...

  • Senior Technical Solutions Engineer

    1 week ago

    bangalore, India Databricks Full time

    P-1376Job Overview:We are seeking a highly skilled Frontline Senior Technical Solutions Engineer with over 5 years of experience to join our Platform Support team. This role is pivotal in delivering exceptional support for our Databricks Data Intelligence platform, addressing complex technical challenges, and ensuring the seamless operation of our data...

  • Senior Data Engineer

    4 weeks ago

    bangalore, India SID Information Technologies Full time

    Role: Senior Data Engineer (Python, Spark/Databricks, SQL, AWS) Experience: 6–12 years Location: Hyderabad Work Mode: Hybrid (3 days/week in-office) Join Time: Immediate Must-Have Technical Skills: Strong programming skills in Python or Scala, Spark/Databricks Hands-on experience with Apache Spark for big data processing on AWS cloud Proficiency with AWS...

  • Databricks AWS DE Analyst

    1 week ago

    bangalore, India BSR & Co Full time

    DescriptionBachelor's degree in computer science, Data Science, engineering, mathematics, information systems, or a related technical discipline1+ years of relevant experience in data engineering rolesDetailed knowledge of data warehouse technical architectures, data modelling, infrastructure components, ETL/ ELT and reporting/analytic tools and...

  • AWS Data Engineer

    2 weeks ago

    bangalore, India Insight Global Full time

    Job Details:Data Engineer (AWS)RemoteHyderabadWe are seeking a highly skilled AWS Data Engineer to join our team and help design, build, and maintain scalable data pipelines and infrastructure in the cloud. The ideal candidate will have experience working with AWS services, relational databases, and ETL processes, as well as expertise in building out...