Sr. Data Engineer

5 days ago

chennai district, India Gravity Infosolutions, Inc. Full time

Role: Sr. Data Engineer – AWS Databricks / Data Tech Lead Type: Contract Location: Chennai / Hyderabad Experience: 5+ years Duration: 3 Months+ Extendable Key Responsibilities: Data Pipeline Development: Design and implement robust ETL/ELT pipelines using Databricks, PySpark, and Delta Lake to process structured and unstructured data efficiently. Manage job orchestration, scheduling, and workflow automation through Databricks Workflows or Airflow . Performance Optimization: Tune and optimize Databricks clusters and notebooks for performance, scalability, and cost-efficiency. Data Governance: Implement data governance and lineage using Unity Catalog and other platform-native features Collaboration: Work closely with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions that meet business needs. Cloud Integration: Leverage cloud platforms (AWS) to build and deploy data solutions, ensuring seamless integration with existing infrastructure. Data Modeling: Develop and maintain data models that support analytics and machine learning workflows. Automation & Monitoring: Implement automated testing, monitoring, and alerting mechanisms to ensure data pipeline reliability and data quality. Documentation & Best Practices: Maintain comprehensive documentation of data workflows and adhere to best practices in coding, version control, and data governance. Required Qualifications: Experience: 5+ years in data engineering, with hands-on experience using Databricks and Apache Spark. Programming Skills: Proficiency in Python and SQL; Cloud Platforms: Strong experience with cloud services such as AWS (e.g., S3, Glue, Redshift Data Engineering Tools: Familiarity with tools like Airflow, Kafka, and dbt. Data Modeling: Experience in designing data models for analytics and machine learning applications. Collaboration: Proven ability to work in cross-functional teams and communicate effectively with non-technical stakeholders. Primary Skill Set: Databricks, Apache Spark/Pyspark, Python, SQL, ETL/ELT development, Delta Lake, Cloud platforms (AWS), Data modeling, Cross-functional collaboration, Communication Secondary Skill Set: Airflow, dbt, Kafka, Hadoop, MLflow, Unity Catalog, Delta Live Tables, Cluster optimization, Data governance, Security and compliance, Databricks certifications.

  • Sr Data Engineer

    5 days ago

    pune district, India Populace World Solutions Full time

    Job Title: Sr. Data Engineer Experience: 8+ Years Location: Pune (Kharadi) Job Description 8+ years of experience as a big data engineer. Must be proficient with Python & PySpark In-depth knowledge of Hadoop, Apache Spark, Databricks, Delta Tables, AWS data analytics services Must have extensive experience with Delta Tables, JSON, Parquet file format Good to...

  • Senior Data Scientist

    3 days ago

    chennai district, India Crayon Data Full time

    Role: Sr Data Scientist Experience level: 5 to 7 years Location: Chennai Why Crayon? Why now? Crayon is transforming into an AI first company, and every Crayon (that’s what we call ourselves!) is undergoing a journey of upskilling and expanding their capabilities in the AI space. We're building an organization where AI is not a department—it’s a way of...

  • Sr. Data Engineer

    1 day ago

    Chennai, Tamil Nadu, India ixceed Full time ₹ 30,00,000 - ₹ 35,00,000 per year

    Role: Sr. Data Engineer (Scala)Location: ChennaiWork Mode: HybridEmployment Type: Full-time PermanentOverview:We are seeking an experienced Senior Data Engineer with deep expertise in Scala and big data technologies to contribute to a cutting-edge project. This role focuses on designing and implementing high-performance data pipelines and processing...

  • Sr .Net Engineer

    1 week ago

    Chennai, Tamil Nadu, India NTT DATA Full time ₹ 40,00,000 - ₹ 1,20,00,000 per year

    Req ID: 338986NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr .Net Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). Who We Are: NTT DATA America strives...

  • Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India Infyjob Technology Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Looking for Sr AWS Data Engineer , Tech Lead , And Architect .4 to 15 Yrs of exp

  • Data Engineer

    4 weeks ago

    Chennai, India NTT DATA Full time

    Job Description Req ID:     NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). Job Duties: As a data...

  • Sr. Emulation Engineer

    5 days ago

    hyderabad district, India ACL Digital Full time

    Sr. Emulation Engineer Job Description 4-5 yrs of experience in emulation/prototyping using Cadence/Synopsys tool flows (Palladium/Protium/HAPS/Zebu) Working knowledge of System Verilog & Verilog language semantics and compilation flows Solid understanding on SOC architecture and AXI protocol Good communication skills and team collaboration Experience: 3 to...

  • Senior Data Scientist

    7 days ago

    Chennai, India Crayon Data Full time

    Role: Sr Data ScientistExperience level: 5 to 7 yearsLocation: ChennaiWhy Crayon? Why now?Crayon is transforming into an AI first company, and every Crayon (that’s what we call ourselves!) is undergoing a journey of upskilling and expanding their capabilities in the AI space.We're building an organization where AI is not a department—it’s a way of...

  • Senior Data Scientist

    1 week ago

    Chennai, India Crayon Data Full time

    Role: Sr Data ScientistExperience level: 5 to 7 yearsLocation: ChennaiWhy Crayon? Why now?Crayon is transforming into an AI first company, and every Crayon (that’s what we call ourselves!) is undergoing a journey of upskilling and expanding their capabilities in the AI space.We're building an organization where AI is not a department—it’s a way of...

  • Senior Data Scientist

    1 week ago

    Chennai, India Crayon Data Full time

    Role: Sr Data ScientistExperience level: 5 to 7 yearsLocation: ChennaiWhy Crayon? Why now?Crayon is transforming into an AI first company, and every Crayon (that’s what we call ourselves!) is undergoing a journey of upskilling and expanding their capabilities in the AI space.We're building an organization where AI is not a department—it’s a way of...