Senior Big Data Specialist

5 days ago


Shimoga, Karnataka, India beBeeBigDataSpecialist Full time ₹ 15,00,000 - ₹ 25,00,000

Job Title: Senior Big Data Specialist

Skill Set:

  • AWS - Amazon Web Services
  • Python
  • Pyspark

About the Role:

We are seeking a skilled big data specialist to join our team. The ideal candidate will have hands-on experience with AWS, Python, and Pyspark.

Responsibilities:

  1. Built pySpark applications using Spark Dataframes in Python
  2. Optimized spark jobs that process huge volumes of data
  3. Hands on experience with version control tools like Git
  4. Worked with Amazon's Analytics services like Amazon EMR, Amazon Athena, AWS Glue
  5. Amazon's Compute services like Amazon Lambda, Amazon EC2 and Amazon's Storage service like S3 and few other services like SNS
  6. Knowledge of datawarehousing concepts – dimensions, facts, schemas- snowflake, star etc.
  7. Columnar storage formats- Parquet,Avro,ORC etc. Well versed with compression techniques – Snappy, Gzip
  8. Knowledge of AWS databases (atleast one) Aurora, RDS, Redshift, ElastiCache, DynamoDB

What We Offer:

  • A challenging role in a dynamic environment
  • Opportunities for professional growth and development
  • Collaborative team atmosphere

Requirements:

  • 5+ years of overall IT experience
  • Hands on experience in Python and PySpark

  • Big Data Expert

    3 days ago


    Shimoga, Karnataka, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    **Unlocking Big Data Opportunities:**We are seeking a highly skilled data expert to design and develop innovative solutions that drive business growth.Essential Skills:PySparkHiveDesirable Skills:SparkHBaseData Quality ToolsAgile Methodologies ExperienceExposure in Data Ingestion from Various Sources onto Big Data PlatformsRequirements:A minimum of 6-12...


  • Shimoga, Karnataka, India beBeeDataDevelopment Full time ₹ 15,00,000 - ₹ 20,00,000

    Senior Data Development SpecialistJob Description:We are seeking an accomplished data development specialist to take on the key challenge of developing and maintaining high-performance data pipelines, collaborating with analytics and business teams, and implementing best practices to monitor data quality.Develops and maintains scalable data pipelines to...


  • Shimoga, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Transform Your Career as a Senior Data EngineerWe seek a highly skilled data professional to join our team of consultants.This role involves designing, constructing, and optimizing large-scale data processing systems that enable advanced analytics and business intelligence.About the Role:You will collaborate closely with data scientists, analysts, and other...


  • Shimoga, Karnataka, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Solution Architect for Big Data EngineeringWe are seeking an experienced Solution Architect to lead the design and implementation of large-scale data engineering solutions. The ideal candidate will have a strong background in Azure Data Engineering, with expertise in Data Factory, Synapse, Fabric, and Databricks. Additionally, they should have...


  • Shimoga, Karnataka, India beBeeEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Big Data LeaderLead a team of data engineers, working closely with clients and team members to understand their requirements and develop architectures that meet their needs.Key responsibilities include:Building pipelines to bring in various data from multiple sources within the organization and external sources.Collaborating with cross-functional teams to...


  • Shimoga, Karnataka, India beBeeDataManagement Full time ₹ 75,00,000 - ₹ 1,50,00,000

    Job Title:Senior Data Management Specialist">Job Description:We are seeking an experienced Senior Data Management Specialist to support data management activities across multiple business divisions. This role involves ensuring compliance with data management policies and procedures.The ideal candidate will have 3-5 years of experience in data management,...


  • Shimoga, Karnataka, India beBeeCloudData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Cloud Data SpecialistAbout the Role:We are seeking a highly skilled Cloud Data Specialist to collaborate with data science teams and implement complex algorithms and analytical solutions.Collaborate with cross-functional teams to design and develop scalable data pipelines.Develop predictive models to drive actionable insights for business...


  • Shimoga, Karnataka, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 16,00,000

    Job Title: Data EngineerWe are seeking a seasoned data professional to design, build, and maintain large-scale data pipelines.Key Responsibilities:CID/CD Pipeline Management: Design, implement, and manage CI/CD pipelines using GitHub Actions or equivalent tools, ensuring seamless code integration and deployment.Github Branch Protection: Configure and...


  • Shimoga, Karnataka, India beBeeCloudera Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Data Infrastructure SpecialistRole Overview: We are seeking an experienced professional to manage and optimize our data infrastructure.Key Responsibilities:Configure and administer distributed data storage systemsMigrate data between platforms with minimal downtimePerform in-depth analysis and optimization of system performanceProvide pre- and...


  • Shimoga, Karnataka, India beBeePerformance Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Senior Data EngineerThis role is ideal for a skilled professional who can design, build, and maintain high-performance data pipelines. Key Responsibilities: Design and implement scalable batch processing systems using Python and big data technologies Optimize database performance, focusing on slow-running queries and latency improvements Use...