Databricks Architect

3 days ago

tamil nadu, India Decision Minds Full time

Role DescriptionThis is a full-time hybrid role ( Multiple roles) for a Databricks lead and Architect located in Chennai and Pondicherry, with the flexibility to work remotely on occasion. The Databricks Architect will be responsible for designing scalable architectures, developing software solutions, integrating Databricks with other platforms, and creating efficient architectural designs. Additionally, the role involves collaborating with cross-functional teams, managing projects to ensure timely delivery, and supporting the implementation of Databricks solutions that align with business goals.Key Responsibilities: Be the go to person for everything related to solutioning and Architecture. Should be leading the the team.Lead the migration of Oracle Data Warehouse to Databricks, ensuring minimal downtime and data integrity. Work on data pipelines using Databricks best practices for performance, cost, and reliability, while guiding junior engineers. Optimize Spark/PySpark jobs for performance and efficiency in processing large datasets. Implement data quality checks, validation, and reconciliation processes during migration. Work on Hadoop ecosystem (HDFS, Hive, Sqoop) for legacy data integration where needed. Leverage AWS cloud services (S3, EMR, EC2, Lamda, RDS, Glue) for data storage and processing. Implement CI/CD pipelines for automated deployment of Databricks workflows. Ensure data governance, security, and compliance in the cloud environment. Mandatory Skills & Experience: 5+ years in Data Engineering, with strong expertise in Databricks, Oracle, and Data Warehousing. Hands-on experience in migrating on-prem data warehouses (Oracle) to Databricks. Hands on expertise using key features of Databricks ( Lakeflow connect, Lakebridge, Autoloader, Unity Catalog, Spark Declarative Pipelines, Lakehouse Architecture)Proficiency in PySpark, SQL, and ETL/ELT frameworks. Strong knowledge of Hadoop ecosystem (HDFS, Hive, Sqoop). Experience with AWS cloud services (S3, EMR, Glue, Lambda, RDS). Familiarity with data modeling, CDC, and performance tuning in Databricks. Good understanding of orchestration tools (Airflow, Control-M) and CI/CD pipelines. Proficiency in Architecture, Architectural Design, and IntegrationStrong Project Management skills to lead and ensure project milestones are metAbility to work with cloud-based platforms and familiarity with AI/ML and Big Data technologiesExcellent problem-solving and analytical skillsStrong communication and collaboration skills to work effectively in a hybrid environmentExperience with Databricks and end-to-end deployment of data solutions is highly desirableBachelor’s or Master’s degree in Computer Science, Engineering, or a related field

  • Databricks Architect

    22 hours ago

    tamil nadu, India Mastech Digital Full time

    Job Title: Databricks ArchitectLocation: Chennai/Hyderabad/BangaloreExperience: 10–15 years of overall experience, at least 6 to 8 years in Databricks 5+ years in Data ArchitectureBudget: Open to discussNotice Period: Immediate joiner/ Serving notice with less than 60 days/Notice is less than 60 daysAbout the RoleWe are seeking a seasoned Databricks...

  • Databricks Architect

    2 weeks ago

    Chennai, Tamil Nadu, India, Tamil Nadu Mastech Digital Full time

    Job Title: Databricks ArchitectLocation: Chennai/Hyderabad/BangaloreExperience: 10–15 years of overall experience and 5+ years in Data ArchitectureBudget: Open to discussNotice Period: Immediate joiner/ Serving notice with less than 60 days/Notice is less than 60 daysAbout the RoleWe are seeking a seasoned Databricks Architect with 10–15 years of overall...

  • Principal Architect

    6 days ago

    tamil nadu, India Tiger Analytics Full time

    Title : Principal Architect – Databricks Location : Chennai, Bengaluru, Hyderabad Who we are Tiger Analytics is a global leader in AI and analytics, helping Fortune 1000 companies solve their toughest challenges. We offer full-stack AI and analytics services & solutions to empower businesses to achieve real outcomes and value at scale. We are on a mission...

  • Databricks

    3 days ago

    tamil nadu, India Tata Consultancy Services Full time

    We are hiring for Databricks Admin Role: Databricks Admin Experience: 5 years to 15 yearsLocation: Bangalore, Chennai, Delhi, Mumbai, Pune, Hyderabad Interested candidates can send their resume on below mail ID along with below details-geethanjali.u@tcs.com Please share below details-Full Name:Email:Contact Details:Total Experience:Current location:Preferred...

  • Principal Architect

    2 weeks ago

    Chennai, Tamil Nadu, India, Tamil Nadu Tiger Analytics Full time

    Title : Principal Architect – Databricks Location : Chennai, Bengaluru, Hyderabad Who we areTiger Analytics is a global leader in AI and analytics, helping Fortune 1000 companies solve their toughest challenges. We offer full-stack AI and analytics services & solutions to empower businesses to achieve real outcomes and value at scale. We are on a mission...

  • Data Architect- Databricks

    2 weeks ago

    Chennai, Tamil Nadu, India InfoCepts Full time

    **Position**: Data Architect (Databricks, Snowflake) **Location**: Nagpur, Pune, Chennai, Bangalore **Type of Employment**:Full time Employment **Purpose of the Position**: Design and optimize cloud-native data architectures on platforms like Databricks and Snowflake, enabling scalable data engineering, advanced analytics, and AI/ML solutions aligned with...

  • Databricks Lead

    2 weeks ago

    Chennai, Tamil Nadu, India, Tamil Nadu Mastech Digital Full time

    Job Title: Databricks Lead Location: Chennai/Hyderabad/BangaloreExperience: 8-10 years of overall experience and 5+ years of hands-on leadership in data engineering projectsBudget: Open to discussNotice Period: Immediate joiner/ Serving notice with less than 60 days/Notice is less than 60 daysAbout the RoleWe are looking for a highly skilled Databricks Lead...

  • Azure Databricks

    4 days ago

    Chennai, Tamil Nadu, India Cognizant Full time

    **Technical Lead** **Qualification**: Bachelors in science, engineering or equivalent ** Responsibility**: **Project Planning and Setup**: - Understand the project scope, identify activities/ tasks, task level estimates, schedule, dependencies, risks and provide inputs to Module Lead for review. - Provide inputs to testing strategy, configuration,...

  • Principal Consultant, Sr. Databricks Developer

    7 days ago

    Chennai, Tamil Nadu, India GENPACT Full time

    Ready to shape the future of work At Genpact we don t just adapt to change we drive it AI and digital innovation are redefining industries and we re leading the charge Genpact s AI Gigafactory our industry-first accelerator is an example of how we re scaling advanced technology solutions to help global enterprises work smarter grow faster and transform at...

  • Azure Data Architect

    2 weeks ago

    tamil nadu, India Tata Consultancy Services Full time

    Role- Azure Data Architect Year of Experience- 10 to 15 years Location- Pan India Skills Required- Databricks, Azure Data Engineering, ADF, ADB, Data Architecture, Interested candidates share your resume to