Sr. data engineer

5 days ago

Chennai, India Gravity Infosolutions, Inc. Full time

Role: Sr. Data Engineer – AWS Databricks / Data Tech Lead Type: ContractLocation: Chennai / HyderabadExperience: 5+ yearsDuration: 3 Months+ ExtendableKey Responsibilities:Data Pipeline Development: Design and implement robust ETL/ELT pipelines using Databricks, Py Spark, and Delta Lake to process structured and unstructured data efficiently.Manage job orchestration, scheduling, and workflow automation through Databricks Workflows or Airflow .Performance Optimization: Tune and optimize Databricks clusters and notebooks for performance, scalability, and cost-efficiency.Data Governance: Implement data governance and lineage using Unity Catalog and other platform-native featuresCollaboration: Work closely with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions that meet business needs.Cloud Integration: Leverage cloud platforms (AWS) to build and deploy data solutions, ensuring seamless integration with existing infrastructure.Data Modeling: Develop and maintain data models that support analytics and machine learning workflows.Automation & Monitoring: Implement automated testing, monitoring, and alerting mechanisms to ensure data pipeline reliability and data quality.Documentation & Best Practices: Maintain comprehensive documentation of data workflows and adhere to best practices in coding, version control, and data governance.Required Qualifications:Experience: 5+ years in data engineering, with hands-on experience using Databricks and Apache Spark.Programming Skills: Proficiency in Python and SQL;Cloud Platforms: Strong experience with cloud services such as AWS (e.g., S3, Glue, RedshiftData Engineering Tools: Familiarity with tools like Airflow, Kafka, and dbt.Data Modeling: Experience in designing data models for analytics and machine learning applications.Collaboration: Proven ability to work in cross-functional teams and communicate effectively with non-technical stakeholders.Primary Skill Set:Databricks, Apache Spark/Pyspark, Python, SQL, ETL/ELT development, Delta Lake, Cloud platforms (AWS), Data modeling, Cross-functional collaboration, CommunicationSecondary Skill Set:Airflow, dbt, Kafka, Hadoop, MLflow, Unity Catalog, Delta Live Tables, Cluster optimization, Data governance, Security and compliance, Databricks certifications.

  • Sr. Data Engineer

    18 hours ago

    Chennai, Tamil Nadu, India ixceed Full time ₹ 30,00,000 - ₹ 35,00,000 per year

    Role: Sr. Data Engineer (Scala)Location: ChennaiWork Mode: HybridEmployment Type: Full-time PermanentOverview:We are seeking an experienced Senior Data Engineer with deep expertise in Scala and big data technologies to contribute to a cutting-edge project. This role focuses on designing and implementing high-performance data pipelines and processing...

  • Sr .Net Engineer

    1 week ago

    Chennai, Tamil Nadu, India NTT DATA Full time ₹ 40,00,000 - ₹ 1,20,00,000 per year

    Req ID: 338986NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr .Net Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). Who We Are: NTT DATA America strives...

  • Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India Infyjob Technology Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Looking for Sr AWS Data Engineer , Tech Lead , And Architect .4 to 15 Yrs of exp

  • Data Engineer

    4 weeks ago

    Chennai, India NTT DATA Full time

    Job Description Req ID:     NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). Job Duties: As a data...

  • Senior Data Scientist

    1 week ago

    Chennai, India Crayon Data Full time

    Role: Sr Data ScientistExperience level: 5 to 7 yearsLocation: ChennaiWhy Crayon? Why now?Crayon is transforming into an AI first company, and every Crayon (that’s what we call ourselves!) is undergoing a journey of upskilling and expanding their capabilities in the AI space.We're building an organization where AI is not a department—it’s a way of...

  • Senior Data Scientist

    1 week ago

    Chennai, India Crayon Data Full time

    Role: Sr Data ScientistExperience level: 5 to 7 yearsLocation: ChennaiWhy Crayon? Why now?Crayon is transforming into an AI first company, and every Crayon (that’s what we call ourselves!) is undergoing a journey of upskilling and expanding their capabilities in the AI space.We're building an organization where AI is not a department—it’s a way of...

  • Senior Data Scientist

    1 week ago

    Chennai, India Crayon Data Full time

    Role: Sr Data ScientistExperience level: 5 to 7 yearsLocation: ChennaiWhy Crayon? Why now?Crayon is transforming into an AI first company, and every Crayon (that’s what we call ourselves!) is undergoing a journey of upskilling and expanding their capabilities in the AI space.We're building an organization where AI is not a department—it’s a way of...

  • Senior Data Scientist

    7 days ago

    Chennai, India Crayon Data Full time

    Role: Sr Data ScientistExperience level: 5 to 7 yearsLocation: ChennaiWhy Crayon? Why now?Crayon is transforming into an AI first company, and every Crayon (that’s what we call ourselves!) is undergoing a journey of upskilling and expanding their capabilities in the AI space.We're building an organization where AI is not a department—it’s a way of...

  • Senior Data Scientist

    1 week ago

    Chennai, India Crayon Data Full time

    Role: Sr Data ScientistExperience level: 5 to 7 yearsLocation: ChennaiWhy Crayon? Why now?Crayon is transforming into an AI first company, and every Crayon (that’s what we call ourselves!) is undergoing a journey of upskilling and expanding their capabilities in the AI space.We're building an organization where AI is not a department—it’s a way of...

  • Senior Data Scientist

    1 week ago

    Chennai, India Crayon Data Full time

    Role: Sr Data ScientistExperience level: 5 to 7 yearsLocation: ChennaiWhy Crayon? Why now?Crayon is transforming into an AI first company, and every Crayon (that’s what we call ourselves!) is undergoing a journey of upskilling and expanding their capabilities in the AI space.We're building an organization where AI is not a department—it’s a way of...