Lead Big Data Administrator

6 hours ago

Bengaluru, Karnataka, India Epsilon Data Management Full time

Responsibilities 4 years experience with Databricks Lakehouse Platform Experience as the Databricks account owner, managing workspaces, AWS accounts, audit logs, and high-level usage monitoring.

Experience as Databricks workspace admin, managing workspace users and groups including single sign-on, provisioning, access control, and workspace storage.

Demonstrated ability to troubleshoot end-user and platform-level issues.

Familiarity with configuring cluster and job settings in Databricks.

Monitor and manage platform costs, including optimizing resource utilization to control expenses.

Implement and enforce security policies, access controls, and encryption mechanisms.

Good understanding of S3 access management across a diverse user base.

Monitor and manage auto-scaling to ensure resources are allocated efficiently.

Stay up to date with security standards and compliance requirements.

Maintain detailed documentation of configurations, procedures, and standard processes.

Good understanding of AWS concepts and networking Good to have experience in provisioning databricks workspace with terraform Experience with databricks asset bundles Interact with vendor support to ensure open issues are resolved within defined SLA.

Conduct training sessions to educate users on platform standards and capabilities.

Collaborate with multi-functional teams, including data scientists, data engineers, and business analysts, to understand their requirements and provide technical solutions.

Collaborate with data engineers to integrate Databricks with other data sources, data warehouses, and data lakes.

Provide 24 x 7 x 365 support through on-call rotation.

Qualifications

8+ years of general technology experience (preferably database administration) 3 years experience with Databricks Lakehouse Platform (AWS preferred) Strong knowledge of Python, Apache Spark and Databricks architecture.

Proficiency in cloud platforms like AWS, Azure, or Google Cloud.

Experience with Linux/Unix system administration.

Strong Unix/Linux and shell scripting Competence to read and write SQL code.

Ability to diagnose problems and resolve issues across various tiers Alignment to SDLC, Change Management, troubleshooting and development methodologies.

Ability to perform work with minimal supervisory direction Excellent written and verbal communication skills Superb analytical and problem-solving skills Education/Certification: B S.

in Computer Science or related subject area or equivalent work experience required.

Databricks Platform Administration and/or AWS certification is a plus.

  • Lead Big Data Administrator

    4 days ago

    Bengaluru, Karnataka, India Epsilon Full time

    OverviewAbout Business Unit:A consolidated team of database technology professionals, we deliver expert insights across all major database engines and Big Data solutions to support Epsilon products and platforms. The team has a one-of-a-kind alignment that combines a horizontal organizational structure with vertically aligned sub-groups dedicated to our...

  • Data Center Administrator

    4 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Req ID: 349078NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Center Administrator to join our team in Bangalore, Karnātaka (IN-KA), India (IN). A Data Center Administrator...

  • Big Data Developer

    2 weeks ago

    Bengaluru, Karnataka, India Xebia Full time ₹ 5,00,000 - ₹ 25,00,000 per year

    Job Title : Big Data Developer - Spark/ScalaJob location : BengaluruNotice Period : immediate - 15 daysPosition Overview : We are looking for Scala/Spark developers with strong expertise on Python / Hadoop and Azure cloud ..Big Data Orchestration: Airflow, Spark on Kubernetes, Yarn, OozieBig Data Processing: Hadoop, Kafka, Spark & Spark Structured...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Acme Services Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    We are looking for Big Data Engineer who has experience with:- 1) Big Query 2) Pyspark 3) GCP or AWS or Azure Required Candidate profileCandidate should have more than 5 Years of overall experience in Data Engineer. We are not looking for Data Analyst or Snowflake Developer.

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Brillio Full time

    Key skills - Hive, SQL, Python, Spark, Hadoop and kafka , apache airflowJob Title Big Data EngineerRole OverviewWe are seeking a highly skilled Big Data Engineer to join our team. The ideal candidate will have strong experience in building, maintaining, and optimizing large-scale data pipelines and distributed data processing systems. This role involves...

  • Big Data Developer

    2 days ago

    Bengaluru, Karnataka, India PradeepIT Consulting Services Full time

    L3 Big datadeveloper Years)1. Design, develop, and implement highly scalable and distributed big datasolutions using Hadoop ecosystem technologies such as HBase, Hive, Kudu, andSpark.2. Architect HBase schemas and data models to accommodate evolving businessrequirements and ensure optimal performance for data storage and retrievaloperations.3. Develop...

  • Big Data Engineer

    5 days ago

    Bengaluru, Karnataka, India RiskInsight Consulting Full time

    ResponsibilitiesDesign, develop, and implement robust Big Data solutions using technologies such as Hadoop, Spark, and NoSQL databases. Build and maintain scalable data pipelines for effective data ingestion, transformation, and analysis. Collaborate with data scientists, analysts, and cross-functional teams to understand business requirements and translate...

  • Big Data Developer

    1 week ago

    Bengaluru, Karnataka, India Sourcebae Full time

    Job Alert: Senior Big Data Engineer (5-8 Yrs) | Spark, Python, Scala Are you a seasonedBig Data Engineerready to build and optimize large-scale, distributed data processing applications? We are seeking a senior engineer with5-8 yearsof experience in the core Big Data ecosystem to deliver high-performance solutions.This is a great opportunity to join a...

  • Big Data Engineer

    7 days ago

    Bengaluru, Karnataka, India Aqilea (formerly Soltia) Full time

    We are a consulting company with a bunch of technology-interested and happy people We love technology, we love design and we love quality. Our diversity makes us unique and creates an inclusive and welcoming workplace where each individual is highly valued. With us, each individual is her/himself and respects others for who they are and we believe that when...

  • Big Data Engineer

    5 days ago

    Bengaluru, Karnataka, India Aqilea Full time

    We are a consulting company with a bunch of technology-interested and happy peopleWe love technology, we love design and we love quality. Our diversity makes us unique and creates an inclusive and welcoming workplace where each individual is highly valued.With us, each individual is her/himself and respects others for who they are and we believe that when a...