Databricks Consultant

2 weeks ago

Bengaluru, Karnataka, India GyanSys Inc. Full time

About GyanSys Inc.

GyanSys Inc. is a leading global systems integrator headquartered in the U.S., specializing in SAP, Salesforce, Microsoft, and ServiceNow solutions. With over 2,000 consultants worldwide and 300+ enterprise clients, GyanSys is at the forefront of delivering digital transformation and business process automation across industries.

Our India delivery centers in Bengaluru, Hyderabad, and Pune play a critical role in driving global implementations for Fortune 500 companies. At GyanSys, you'll find a collaborative culture, cutting-edge projects, continuous learning opportunities , and the ability to make a real impact .

Job Title: Databricks Consultant

Experience: 3-5 Years

Location: Bengaluru (Work from Office)

Immediate Joiners Preferred

Roles and Responsibilities – Databricks Consultant (3–5 Years Experience)

1. Data Engineering & Pipeline Development

  • Design, develop, and maintain scalable ETL/ELT pipelines on Databricks using Apache Spark .
  • Proficient in Python, SQL and R.
  • Implement data transformations using PySpark, SQL, Delta Lake , and Databricks notebooks .
  • Build and optimize batch and streaming data pipelines based on business requirements.

2. Platform Implementation & Integration

  • Assist in the setup, configuration, and administration of the Databricks workspace , clusters, and Unity Catalog.
  • Integrate Databricks with various data sources like Azure Data Lake, AWS S3, Kafka, and relational databases.
  • Support ingestion from source systems and delivery to analytics platforms or data warehouses.

3. Performance Tuning & Optimization

  • Optimize Spark jobs for cost efficiency and runtime performance .
  • Monitor and troubleshoot cluster performance, job failures, and data quality issues.
  • Implement data caching, partitioning, and optimization techniques using Delta Lake.

4. Collaboration & Stakeholder Communication

  • Work closely with data scientists, analysts, and business users to gather and translate requirements.
  • Support analytics and ML teams by preparing clean, structured, and timely datasets.
  • Participate in Agile ceremonies (scrum, sprint planning, retrospectives) as part of a cross-functional team.

5. Documentation & Best Practices

  • Create and maintain technical documentation for pipelines, data flows, and system components.
  • Follow industry and organizational best practices for code quality, version control, and CI/CD .

6. Governance, Quality, and Security

  • Implement data validation, quality checks, and logging frameworks within Databricks pipelines.
  • Support data security, compliance , and role-based access control (RBAC) practices via Unity Catalog or cloud-native IAM.
  • Ensure auditability and traceability of all jobs and data movement.

  • People Generalist

    3 weeks ago

    Bengaluru, Karnataka, India Databricks Full time

    Job DescriptionGAQ326R189About The RoleAs a Databricks People Generalist, you will play a critical role in supporting our managers across the organization. Youll be responsible for delivering thoughtful people solutions that enable strong leadership, high performance, and an inclusive culture. You will empower managers to confidently navigate every stage of...

  • Sr. Solutions Engineer

    4 weeks ago

    Bengaluru, Karnataka, India Databricks Full time

    Job DescriptionFEQ426R153As a Sr. Solutions Engineer (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a technical advisor internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our...

  • Partner Solutions Engineer

    4 weeks ago

    Bengaluru, Karnataka, India Databricks Full time

    Job DescriptionFEQ125R56As a Partner Solutions Architect (PSA) for India, you will work with Databricks&apos Consulting and System Integrator (C&SI) partners, teammates, and with the technical and sales team members who work directly with our customers. You will develop &apostechnical champions&apos within our top C&SI Partners, providing enablement on...

  • Sr. Solutions Engineer

    6 days ago

    Bengaluru, Karnataka, India Databricks Full time US$ 1,20,000 - US$ 2,00,000 per year

    FEQ426R153As a Sr. Solutions Engineer (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a technical advisor internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve...

  • Solutions Architect

    6 days ago

    Bengaluru, Karnataka, India Databricks Full time US$ 1,50,000 - US$ 2,00,000 per year

    FEQ426R138As a Solutions Architect (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a technical advisor internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve...

  • DataBricks Consultant Hiring

    5 days ago

    Bengaluru, Karnataka, India KPMG Global Services Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Bachelors or higher degree in Computer Science or a related discipline; or equivalent (minimum 5 years work experience).  At least 2+ years of consulting or client service delivery experience on Azure At least 2+ years of experience in developing data ingestion, data processing and analytical pipelines for big data, relational databases such as SQL server...

  • Databricks Data Specialist

    6 days ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Unlock Your Potential as a Databricks Consultant!GyanSys Inc. is a leading global systems integrator, specializing in SAP, Salesforce, Microsoft, and ServiceNow solutions.Our team works closely with data scientists, analysts, and business users to gather and translate requirements.As a Databricks Consultant, you'll have the opportunity to work on...

  • Databricks Engineer

    2 weeks ago

    Bengaluru, Karnataka, India DataZymes Full time

    ABOUT US:  Founded in 2016, DataZymes is a next-generation analytics and data science company driving technology and digital-led innovation for our clients, thus helping them get more value from their data and analytics investments. Our platforms are built on best-of-breed technologies, thus protecting current investments while providing clients more bang...

  • Databricks Engineer

    2 weeks ago

    Bengaluru, Karnataka, India DataZymes Full time

    ABOUT US:  Founded in 2016, DataZymes is a next-generation analytics and data science company driving technology and digital-led innovation for our clients, thus helping them get more value from their data and analytics investments. Our platforms are built on best-of-breed technologies, thus protecting current investments while providing clients more bang...

  • 15h Left Lead Consultant- Databricks Developer

    24 hours ago

    Bengaluru, Karnataka, India GENPACT Full time

    Genpact NYSE G is a global professional services and solutions firm delivering outcomes that shape the future Our 125 000 people across 30 countries are driven by our innate curiosity entrepreneurial agility and desire to create lasting value for clients Powered by our purpose - the relentless pursuit of a world that works better for people - we...