Big Data Specialist

2 hours ago

Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000
Senior Data Engineer

Job Title: Senior Data Engineer

About the Role:

We are seeking an experienced data engineer to design and maintain large-scale data systems that support business needs.

Key Responsibilities:

  • Design, build, and maintain optimal data pipeline architecture using SQL and big data technologies.
  • Build tools for analytics team members to assist in building and optimizing products.
  • Work with data scientists to improve functionality in data systems.
  • Implement process improvements, automate manual processes, optimize data delivery, and redesign infrastructure for greater scalability.
  • Experience working with big data tools, relational databases, and workflow management tools.

Mandatory Qualifications:

Proficiency in Scala or Python, expertise in Spark, and experience with performance tuning and optimization. DBT is mandatory.

We require a candidate with 2+ years of experience as a Data Engineer. Experience with cloud services, stream-processing systems, object-oriented/scripting languages, and 'big data' pipelines is necessary.

Requirements:

  • Strong analytical skills related to structured/unstructured datasets.
  • Ability to build processes supporting data transformation, dimensional modeling, metadata, dependency, schema registration/evolution, and workload management.
  • Working knowledge of message queuing, stream processing, and highly scalable data stores.

Nice to Have:

  • A few side projects up on GitHub.
  • Contributed to an open-source project.
  • Worked at a product company.
  • Working knowledge of backend programming languages.

Preferred Qualifications:

Strong proficiency in Scala or Python, hands-on expertise in Apache Spark, and ability to handle large datasets efficiently.

  • Senior Big Data Technology Expert

    1 day ago

    Gulbarga, Karnataka, India beBeeBigData Full time ₹ 1,20,00,000 - ₹ 2,50,00,000

    Big Data Specialist OpportunityThe ideal candidate for this role will possess a thorough understanding of big data ecosystem tools, including Scala, Spark, Hive, and Hadoop. They should also have expertise in strong SQL experience and be able to develop, tweak queries, and work on performance enhancement.

  • Big Data Developer

    4 weeks ago

    Gulbarga, Karnataka, India DigiHelic Solutions Pvt. Ltd. Full time

    Job descriptionKey Responsibilities:Big Data Architecture: Design, develop, and maintain scalable and distributed data architectures capable of processing large volumes of data.Data Storage Solutions: Implement and optimize data storage solutions using technologies such as Hadoop, Spark, and PySpark.PySpark Development: Develop and implement efficient ETL...

  • Big Data Cloud Specialist

    2 days ago

    Gulbarga, Karnataka, India beBeeCloud Full time ₹ 36,00,000 - ₹ 48,00,000

    Job Title: Cloud Architect for Big Data SolutionsJob Description:We are seeking a highly skilled Cloud Architect with expertise in Big Data management and data quality to join our team. As a key member of our organization, you will be responsible for designing and implementing scalable cloud-based solutions that meet the needs of our clients.The ideal...

  • Big Data Engineer

    5 days ago

    Gulbarga, Karnataka, India Tata Consultancy Services Full time

    Greetings from TCSTCS is hiring for Big Data Location: - Chennai/Mumbai/PuneDesired Experience Range: 6 to 12 yearsMust-Have • PySpark • HiveGood-to-Have• Spark • HBase • DQ tool • Agile Scrum experience • Exposure in data ingestion from disparate sources onto Big Data platformThanksAnshika

  • Big Data Solutions Specialist

    4 hours ago

    Gulbarga, Karnataka, India beBeeData Full time US$ 7,50,000 - US$ 15,00,000

    Role SummaryWe are seeking a highly skilled Big Data Developer to join our data engineering team. As a key member of the team, you will be responsible for designing, developing, and deploying large-scale data processing systems.Key ResponsibilitiesDesign and develop scalable data processing systemsDevelop and implement efficient algorithms for data...

  • Chief Big Data Architect

    1 week ago

    Gulbarga, Karnataka, India beBeeDataEngineering Full time US$ 80,000 - US$ 1,40,000

    Big Data EngineerThe role involves working on large-scale data processing systems, leveraging expertise in Big Data technologies to drive business growth.Required Skills and Qualifications:Proficiency in Python programming language

  • Visionary Big Data Engineer

    5 days ago

    Gulbarga, Karnataka, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    We are seeking a seasoned Big Data Solutions Architect to spearhead the development of large-scale data processing systems.The ideal candidate will have 8-15 years of experience in designing and implementing big data engineering solutions using technologies such as Apache Spark, Hadoop, Hive, and NoSQL databases.Key skills required include:

  • Lead Big Data Engineer

    4 hours ago

    Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 24,00,000

    About the Role:This position requires a highly skilled data engineer to develop efficient and scalable data pipelines, perform integration testing, and provide estimates for development, testing & deployments.Key Responsibilities:Design and implement high-quality data pipelines that support increasing data volume and complexityCollaborate with analytics and...

  • Senior Big Data Architect

    6 days ago

    Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Big Data Engineer OpportunityWe are seeking a highly skilled Big Data Engineer to join our data engineering team. The ideal candidate will have expertise in Scala, Spark, Python, NiFi, and Apache Kafka.The role involves designing, developing, and optimizing large-scale data pipelines and distributed data processing systems. Strong experience in cloud-based...

  • Big Data Solutions Architect

    3 hours ago

    Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Data Engineer PositionWe are seeking an experienced Data Engineer to design and implement big data solutions.The ideal candidate will have expertise in distributed computing principles, Apache Spark, and Python programming.Key responsibilities include designing and implementing big data solutions using technologies like Apache Spark, Hadoop, and NoSQL...