Big Data Intelligence Specialist

2 days ago

Thrissur, Kerala, India beBeeDataMining Full time ₹ 80,00,000 - ₹ 1,20,00,000
Job Title: Data Mining Analyst

This is a challenging role that involves automating data extraction processes from web platforms to gain valuable insights and make informed business decisions.

We are seeking a skilled professional with expertise in Python, Selenium, Pandas, SQL, and APIs to design and implement efficient and scalable data scraping systems.

Main Responsibilities:
  • Design, develop, and maintain robust web scraping solutions to extract structured and unstructured data from various websites and APIs.
  • Utilize tools like Python, Selenium, BeautifulSoup, Scrapy, and Pandas for data scraping and processing to ensure accuracy and efficiency.
  • Build and manage automated scripts to scrape dynamic websites, including handling JavaScript-driven content, to stay ahead of the competition.
  • Ongoing optimization of scraping workflows to ensure data extraction is accurate, efficient, and scalable.
  • Collaborate with stakeholders to gather and integrate data from various sources, ensuring proper rate limits and authentication handling.
  • Clean, preprocess, and store extracted data in databases (SQL) or cloud-based systems for future reference.
  • Collaborate with data analysts to provide required data for further analysis and reporting.
  • Debug and troubleshoot issues in scraping pipelines and scripts to minimize downtime.

The ideal candidate will have a passion for working with data and a solid understanding of web technologies to drive business success.

We leverage data analytics and automation to help e-commerce brands overcome complexities in today's e-commerce landscape.

  • Big Data Specialist

    1 day ago

    Thrissur, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Big Data SpecialistWe are seeking a skilled big data professional to fill this role. As a big data specialist, you will be responsible for designing and implementing large-scale data processing systems using big data technologies such as Hadoop and Spark.Key Responsibilities:Design and develop scalable data processing architectures using PySpark...

  • Big Data Architect

    11 hours ago

    Thrissur, Kerala, India beBeeData Full time ₹ 17,57,300 - ₹ 24,32,900

    Job Title: Advanced Data Solution ArchitectThis is a high-profile role responsible for designing and implementing sophisticated big data architectures and systems.Key Responsibilities:Design, develop, and deploy scalable and efficient big data platforms using cutting-edge tools and technologiesDevelop and implement ETL processes to extract valuable insights...

  • Big Data Engineering Specialist

    1 day ago

    Thrissur, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OverviewWe are seeking an experienced Big Data Engineer to join our data engineering team. The ideal candidate will have a proven track record in building, scaling, and optimizing big data pipelines, as well as hands-on experience in distributed data systems and cloud-based solutions.Key Responsibilities:Design, develop, and optimize large-scale data...

  • Big Data Engineering Lead

    3 days ago

    Thrissur, Kerala, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Data Scientist - Big Data EngineerWe are looking for a seasoned professional to lead our data engineering initiatives. As a key member of the team, you will be responsible for designing, building, and maintaining large-scale data processing systems.Design and develop scalable data pipelines using Python, PySpark, and AWS services.Collaborate with...

  • Data Operations Specialist

    2 days ago

    Thrissur, Kerala, India beBeeData Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Job Title: Data Operations SpecialistThe Technical Business Analyst role is a key position within the organization, supporting critical operations across process improvement, data platform engineering, and automation. This role contributes to the customer's strategic vision of expanding EDP data entitlement.Main Responsibilities:Process Improvement &...

  • Sr Big Data Developer

    2 weeks ago

    Thrissur, Kerala, India IQVIA Full time

    Job Role: Sr Big Data Developer Years of Experience: 4 to 8 years Job Location: Bangalore Work Mode: Hybrid Must Have Skills: Bigdata Developer, Spark & Scala/Java/Python Experience and Skills: Strong experience with big data technologies and associated tools such as Hadoop, Unix, HDFS, Hive, Impala, etc. Proficient in using Spark &...

  • Senior Big Data Project Lead

    17 hours ago

    Thrissur, Kerala, India beBeeTechnicalProjectManagement Full time US$ 1,00,000 - US$ 1,50,000

    **Job Opportunity:** Technical Project ManagerLocation: Remote ContractThe role of the Technical Project Manager is to lead and manage large-scale projects within big data and analytics environments, particularly on Databricks. The successful candidate will have strong expertise in managing complex technical projects, ensuring timely delivery, scope...

  • Big Data Cluster Manager

    12 hours ago

    Thrissur, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Description:In the role of Big Data Cluster Manager, you will be responsible for overseeing the administration and maintenance of large-scale Cloudera clusters. This entails designing, deploying, and optimizing systems to ensure seamless application migration.Mandatory skills include:Designing and deploying high-performance Cloudera clustersMigrating...

  • Data Governance Specialist

    6 days ago

    Thrissur, Kerala, India beBeeDataGovernance Full time

    Data Governance SpecialistWe are seeking a highly skilled Data Governance Specialist to join our team. The successful candidate will be responsible for ensuring the accuracy, completeness, and consistency of data across our organization.Job Description:Develop and implement data governance strategies that meet business needs.Collaborate with cross-functional...

  • Data Infrastructure Specialist

    12 hours ago

    Thrissur, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    We are seeking a highly skilled Data Engineer to join our organization and drive the development of our data infrastructure. The successful candidate will be responsible for designing, building, and maintaining scalable data pipelines that ensure seamless data availability for analytics, AI/ML, and business intelligence use cases.Key Responsibilities:Design...