Big Data Specialist

5 days ago


Mysore, Karnataka, India beBeeBigData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

Job Title: Big Data Engineer

">Job Description

We are seeking a skilled Big Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems.

">Required Skills and Qualifications
  • Hands on experience in Python and PySpark
  • Experience in building pySpark applications using Spark Dataframes in Python
  • Ability to work with huge volumes of data and optimize spark jobs
  • Knowledge of version control tools like Git
  • Experience in working with Amazon's Analytics services like Amazon EMR, Amazon Athena, AWS Glue
  • Experience in working with Amazon's Compute services like Amazon Lambda, Amazon EC2 and Amazon's Storage service like S3
  • Good knowledge of datawarehousing concepts – dimensions, facts, schemas- snowflake, star etc.
  • Experience in working with columnar storage formats- Parquet,Avro,ORC etc. and compression techniques – Snappy, Gzip
  • Good knowledge of AWS databases (atleast one) Aurora, RDS, Redshift, ElastiCache, DynamoDB
">Benefits

As a Big Data Engineer at our company, you will have the opportunity to work on exciting projects that involve big data processing and analytics. You will also have access to cutting-edge technologies and tools, as well as opportunities for professional growth and development.

">Others

If you are passionate about working with big data and have the skills and qualifications we are looking for, please submit your application.



  • Mysore, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Architecture SpecialistWe are seeking a skilled Data Architecture Specialist to design, develop and maintain large-scale data processing systems.Key Responsibilities:Design and implement robust data pipelines using PySpark and HiveCollaborate with cross-functional teams to achieve business objectivesImplement data quality tools and ensure...


  • Mysore, Karnataka, India beBeeEngineering Full time ₹ 20,00,000 - ₹ 30,00,000

    Senior Big Data Engineer LeaderWe are seeking a highly experienced and strategic leader to head our Big Data platform team. The ideal candidate will have deep expertise in cloud-native environments, Azure Cloud Services, and Databricks.Key Responsibilities:Lead and mentor a team of data engineers working on large-scale distributed data systems.Architect and...


  • Mysore, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Big Data Engineer PositionThe ideal candidate should have a minimum of 5+ years of experience in Big Data technologies, including Hadoop, Spark, Hive, and HDFS.We are looking for an expert to design and develop efficient ETL processes to integrate data from multiple sources into data warehouses/lakes.Collaboration with data analysts, data scientists, and...


  • Mysore, Karnataka, India beBeeData Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Job Title: Senior Software Engineer/Technical SpecialistThis is a highly technical role involving the design, development, and optimization of ETL/ELT pipelines using Azure Data Factory (ADF), Databricks, and Synapse Analytics.Develop and maintain scalable data architectures following Medallion Architecture and best practices.Write and optimize SQL queries...


  • Mysore, Karnataka, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Data ArchitectThis role involves building scalable architectures, working with streaming data, and collaborating with data scientists and business stakeholders to deliver high-quality solutions.Key Responsibilities:Design, build, and optimize data pipelines and ETL workflows.Manage and process large datasets using Spark, PySpark, and SQL.Build and...

  • Data Scientist

    3 days ago


    Mysore, Karnataka, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Title: Data Scientist Job Description:We are seeking a highly skilled and motivated Data Scientist to join our team. The ideal candidate will have experience in Big Data technologies, data analysis, and visualization. Required Skills and Qualifications:Big Data technologies such as Hadoop, Spark, and HiveData analysis and visualization tools like...


  • Mysore, Karnataka, India beBeeAnalytical Full time US$ 1,00,000 - US$ 5,50,000

    Job Title: Data Insights SpecialistAbout the Role:We are seeking a talented Data Insights Specialist to join our team. In this role, you will be responsible for leveraging data analytics and machine learning techniques to extract insights and drive business decisions.Key Responsibilities:


  • Mysore, Karnataka, India beBeeDatabricks Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Title: Databricks EngineerWe are seeking a skilled Databricks professional to join our team. The ideal candidate will have experience in designing, developing and maintaining data pipelines and ETL processes on Databricks.Main Responsibilities:Design and develop scalable, secure and high-performance data solutions using Databricks.Collaborate with...


  • Mysore, Karnataka, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Key Responsibilities:We are seeking a skilled Data Engineer who will be responsible for designing and building large-scale data infrastructures. The ideal candidate will have expertise in real-time data processing using technologies like Kafka, Flink, and Spark.The role involves developing data pipelines, ensuring data quality, and efficiency. The successful...

  • Data Specialist

    1 day ago


    Mysore, Karnataka, India Zetheta Algorithms Private Limited Full time

    About the CompanyZeTheta Algorithms Private Limited is a FinTech start-up which has been recently set up and is developing innovative AI tools.https://www.instagram.com/zetheta.officialAbout the RoleAs a Data Scientist intern, you will work on cutting-edge projects involving financial data analysis, investment research, and risk modelling. You will have the...