Senior Big Data Specialist

3 days ago

sangli, India beBeeDataEngineer Full time

Job OverviewThe ideal candidate will be responsible for designing, developing and maintaining real-time and batch data pipelines in Databricks.Design and implement robust data ingestion frameworks using Databricks Autoloader.Integrate Apache Kafka with Databricks using Structured Streaming.Build and maintain Medallion Architecture pipelines across Bronze, Silver, and Gold layers.Implement checkpointing, output modes and appropriate processing modes in structured streaming jobs.Key Responsibilities:Develop efficient data pipelines to process large datasets.Collaborate with cross-functional teams to design and implement data solutions.Stay up-to-date with the latest industry trends and technologies.Required Skills and Qualifications:Must Have SkillsApache Kafka: Integration, topic management, schema registry (Avro/JSON).Databricks & Spark Structured Streaming:Processing Modes: Append, Update, CompleteOutput Modes: Memory, Console, File, Kafka, DeltaCheckpointing and fault toleranceDatabricks Autoloader: Schema inference, schema evolution, incremental loads.Medallion Architecture implementation expertise.Performance Optimization:Data partitioning strategiesCaching and persistenceAdaptive query execution and cluster configuration tuningSQL & Spark SQL: Proficiency in writing efficient queries and transformations.Data Governance: Schema enforcement, data quality checks, and monitoring.Good to Have Skills:Good to Have SkillsStrong coding skills in Python and PySpark.Experience working in CI/CD environments for data pipelines.Exposure to cloud platforms (AWS/Azure/GCP).Understanding of Delta Lake, time travel and data versioning.Familiarity with orchestration tools like Airflow or Azure Data Factory.Benefits:As a member of our team, you will have the opportunity to work on challenging projects, collaborate with talented individuals and grow your skills and career.Keywords:Real-time data processing, data governance, data engineering, Databricks, Apache Kafka, Medallion Architecture, performance optimization, SQL, Spark SQL.

  • 12th Pass Freshers For Data Entry Specialist

    7 days ago

    Sangli, India Next Step Careers Part time

    job description:we are looking for a detail-oriented data entry analyst to join our team. the ideal candidate will be responsible for inputting data from various sources into our database systems. this role requires the ability to work efficiently and accurately in a fast-paced environment. the data entry specialist will also be responsible for verifying...

  • 12th Pass Freshers For Data Entry Specialist

    1 week ago

    Sangli, India Next Step Careers Full time

    job description:we are looking for a detail-oriented data entry analyst to join our team. the ideal candidate will be responsible for inputting data from various sources into our database systems. this role requires the ability to work efficiently and accurately in a fast-paced environment. the data entry specialist will also be responsible for verifying...

  • Data Architect

    2 weeks ago

    Sangli, India NR Consulting Full time

    ```htmlAbout the CompanyWe are seeking a highly experienced Data Architect with over 10 years in IT and at least 4+ years in data architecture or principal data engineering roles. The ideal candidate will design, implement, and govern large-scale data platforms in cloud environments, ensuring performance, scalability, and security.About the RoleWe are...

  • ENT Specialist Consultant Hiring!! HS

    1 week ago

    Sangli, India Space Consultants Full time

    ENT Specialist needed for reputed Hospitals in Location- 1) Bihar Sitamarhi 2) MaharashtraSangli 3) Rajasthan Bhilwara OTHER DETAILS:- SALARY NEGOTIABLE (BEST IN INDUSTRY) + INCENTIVE EXPERIENCE: FRESHER / EXPERIENCED ANY THE INTERVIEW WILL BE CONDUCTED TELEPHONIC / VIDEO ABOUT US : SPACE CONSULTANT IS A 15 YEARS OLD MEDICAL RECRUITMENT CONSULTANCY, HIRING...

  • Tax Specialist

    3 days ago

    sangli, India DP World Full time

    Designation:Senior Specialist - Tax Reporting & Compliance - Global Service Centre:Role Purpose: To Handle the compliances of Direct and Indirect Taxation for assigned the legal entities in the region.Base Location: Navi MumbaiKey Role Responsibilities:Taxation:End to end GST process including compliance, returns filing, payments, input credits and...

  • Quality Analysis Specialist

    2 weeks ago

    Sangli, Maharashtra, India Rapid Job Sountions Full time ₹ 2,00,000 - ₹ 4,00,000 per year

    Job Title: Quality Analysis SpecialistLocation: Sangli, MaharashtraExperience Level: 0-3 YearsShift: US Shift (Saturday and Sunday Off)About Us:We are a leader in the BPO industry, currently expanding our analytics divisions with a boldobjective: to revolutionize the real estate and financial services sector through our proprietary suite of enterprise-grade...

  • Global Service Desk Engineer

    2 weeks ago

    Sangli, India BDx Data Centers Full time

    Global Service Desk Senior EngineerCOMPANY OVERVIEWBDx is Asia’s fastest-growing data center platform, delivering colocation, build-to-suit, managed services, and interconnection solutions for hyperscalers, large enterprises, and AI customers. Operating across high-growth markets—including Indonesia, Hong Kong, Singapore, and Taiwan—BDx currently...

  • Senior Internal Auditor

    2 weeks ago

    Sangli, India Chronos Consulting Full time

    Senior Internal AuditorLocation - MumbaiIndustry - Oil and GasThe Senior Auditor/ Assistant Manager, has the primary responsibility of conducting financial, operational, compliance, IT audits and special investigations across all of the company's operating divisions and affiliates.Responsibilities Would Include- Develop and execute a comprehensive risk-based...

  • Senior Salesforce Developer

    4 weeks ago

    Sangli, India Tech USA Full time

    Job Title:Senior Salesforce Developer (Sales Cloud & MDM Implementation) Location:Remote or Hybrid (India-based) Employment Type:Freelance/Contract Shift Timings:11:00am IST to 8:00pm IST (Flexible start time between 10am - 10pm IST)About the Position:We are seeking Senior Salesforce Developers for a large client, deeply embedded in the future of networking...

  • Senior Accounting Specialist

    12 hours ago

    sangli, India beBeeAccounting Full time

    Financial Accounting ProfessionalKey responsibilities include preparing monthly, quarterly and annual financial reports.Review accounts to ensure high standards of accuracy and transparency.Collaborate with colleagues to understand revenue and cost drivers.Communicate effectively with internal and external auditors.Required skills: Expertise in Financial...