Lead Big Data Developer

1 week ago

Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

Job Title:

Data Engineer

About the Position:

We are seeking an experienced Senior Data Scientist with a strong background in developing and implementing efficient data pipelines, performing web scraping, and generating actionable insights through dashboards and reports.

Key Responsibilities:

  • Design and Implement Data Collection and Transformation Scripts:
  • Utilize Python to develop scalable and reliable data collection and transformation scripts.
  • Create Web Scraping Solutions:
  • Develop web scraping solutions to extract structured and unstructured data from diverse sources using Scrapy, BeautifulSoup, and Selenium.
  • Clean, Preprocess, and Analyze Data:
  • Utilize Pandas, NumPy, and Scikit-learn to clean, preprocess, and analyze large datasets to identify patterns, trends, and insights.
  • Work with SQL and NoSQL Databases:
  • Collaborate with databases such as PostgreSQL and MongoDB for efficient data storage and retrieval.
  • Develop Interactive Dashboards and Visualizations:
  • Use data visualization libraries like Matplotlib, Seaborn, Plotly and/or BI tools like Power BI, Tableau, and Looker to present metrics and business insights to stakeholders.
  • Optimize Existing Data Workflows:
  • Continuously optimize existing data workflows and pipelines for performance and scalability.
  • Document Code and Methodologies:
  • Document code, workflows, and methodologies for maintainability and collaboration.

Required Skills & Qualifications:

  • Bachelor's degree in Computer Science, Data Science, or related field, or equivalent practical experience.
  • Minimum 2 years of professional experience as a Data Engineer or similar role.
  • Strong proficiency in Python and key data libraries (Pandas, NumPy, Scikit-learn).
  • Familiarity with web scraping tools and libraries (Scrapy, BeautifulSoup, Selenium).
  • Solid understanding of databases with strong SQL skills; exposure to PostgreSQL, MongoDB is a plus.
  • Experience with data visualization libraries (Matplotlib, Seaborn, Plotly) and/or BI tools (Power BI, Tableau, Looker).
  • Strong problem-solving ability, analytical mindset, and attention to detail.
  • Experience using version control systems (Git).

Preferred Qualifications:

  • Exposure to cloud platforms such as AWS, Google Cloud Platform, or Azure.
  • Familiarity with REST APIs for data collection and integration.
  • Understanding of data warehousing concepts.
  • Prior experience working in an Agile development environment.

  • Big Data Lead

    2 weeks ago

    Pune, Maharashtra, India Persistent Full time US$ 1,50,000 - US$ 2,00,000 per year

    About PersistentWe are a trusted Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what's next. Our offerings and proven solutions create a unique competitive advantage for our clients by giving them the power to see beyond and rise above. We work with many...

  • Big Data Developer

    1 week ago

    Pune, Maharashtra, India MRO Full time

    Analyst - Big Data DeveloperWe are seeking a highly skilled Analyst -Big Data Developer to join our dynamic team.The ideal candidate will have extensive experience with big data technologies and a strong background in developing and optimizing data integration frameworks and applications.You will be responsible for designing, implementing, and maintaining...

  • Lead Big Data Engineer

    2 weeks ago

    Pune, Maharashtra, India beBeeDataScientist Full time ₹ 10,00,000 - ₹ 12,00,000

    Big Data Architect PositionWe are seeking a skilled Big Data Architect to lead our team's technical efforts.The ideal candidate will have hands-on experience in designing and developing applications using Big Data, DWH, Cloud technologies, ETL, SQL.Expertise in Spark, Hadoop ecosystem components, and cloud platforms (AWS/Azure/GCP)Good knowledge of Shell...

  • Big Data

    2 weeks ago

    Pune, Maharashtra, India Atgeir Solutions Full time US$ 1,50,000 - US$ 2,00,000 per year

    We're Hiring – 𝐁𝐢𝐠 𝐃𝐚𝐭𝐚 / 𝐂𝐥𝐨𝐮𝐝 𝐀𝐫𝐜𝐡𝐢𝐭𝐞𝐜𝐭Location: 𝐆𝐥𝐨𝐛𝐚𝐥 𝐃𝐞𝐥𝐢𝐯𝐞𝐫𝐲 𝐂𝐞𝐧𝐭𝐞𝐫, 𝐏𝐮𝐧𝐞Type: 𝐅𝐮𝐥𝐥-𝐓𝐢𝐦𝐞Experience: 𝟏𝟎–𝟏𝟓 𝐘𝐞𝐚𝐫𝐬Job ID:...

  • Big Data Engineering Lead

    2 weeks ago

    Pune, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Data Engineering Leader">We are looking for a seasoned Senior Data Engineering Leader to oversee the development and implementation of scalable, distributed data platforms that drive business value.">As a key member of our engineering team, you will be responsible for:">">Designing and architecting high-performance data pipelines that integrate with...

  • Big Data Developer

    2 weeks ago

    Pune, Maharashtra, India Deutsche Bank Full time

    Job Title Big Data DeveloperLocation Pune IndiaRole Description Deutsche Bank is actively renewing its digital channels and has started many strategic and challenging projects Next to some major technological changes Deutsche Bank has decided to step into the Agile software development methodology in order to improve its agility and reduce time to...

  • Big Data Architectural Expert

    2 weeks ago

    Pune, Maharashtra, India beBeeEngineer Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Take Your Career to the Next Level as a Lead Big Data Engineer!Job Description:Are you passionate about harnessing the power of big data to drive business growth and innovation? We're seeking an exceptional Lead Big Data Engineer to join our team and help us build the next generation of big data platforms.The ideal candidate will have extensive experience in...

  • Big Data Developer

    2 weeks ago

    Pune, Maharashtra, India Wroots Global Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Job Title: Big Data Engineer / Software EngineerLocation: Pune Kharadi (Client Location) | WFO 3 days a weekExperience: 6 to 10 yearsJob Description:We are hiring an experienced Software Engineer with strong expertise in big data and cloud technologies.Key Skills:Hands-on experience in Scala / Java / PythonStrong knowledge of Big Data technologies: Spark,...

  • Big Data Developer

    2 weeks ago

    Pune, Maharashtra, India Varite Full time ₹ 7,00,000 - ₹ 11,00,000 per year

    Job Title : Big Data DeveloperLocation State : MaharashtraLocation City : PuneExperience Required : 6 to 8 Year(s)CTC Range : 7 to 11 LPAShift: Day ShiftWork Mode: OnsitePosition Type: C2HOpenings: 3Company Name: VARITE INDIA PRIVATE LIMITEDAbout The Client: Client is an Indian multinational technology company specializing in information technology services...

  • Big Data Developer

    4 weeks ago

    Pune, Maharashtra, India Impetus Full time

    Location : Indore, Pune, Bangalore, Gurugram, Noida Notice period : Can join Immediately or Currently serving ( 30- 45 days ) 3-6 years of good hands on exposure with Big Data technologies – pySpark (Data frame and SparkSQL) Hands-on experience with using Cloud Platform provided Big Data technologies (i.e. Glue, Lambda, RedShift, S3, etc.) Good hands on...