Senior Data Engineer

Job Title: Senior Data Engineer

Company Name: NCSi

Job Description:

NCSi is seeking a highly skilled Senior Data Engineer to join our dynamic team. In this role, you will be responsible for designing, developing, and optimizing data pipelines and architectures to support our data-driven initiatives. You will collaborate with cross-functional teams to understand data requirements and implement robust solutions that enhance data accessibility and reliability. The ideal candidate should have a strong background in data engineering and a passion for transforming raw data into actionable insights.

Key Responsibilities:

- Design, build, and maintain scalable data pipelines and ETL processes.

- Collaborate with data scientists and analysts to understand data needs and provide support for their analytics requirements.

- Develop and implement data models, database designs, and data management solutions.

- Ensure data quality, integrity, and consistency across various data sources.

- Optimize data storage, processing, and retrieval for performance and efficiency.

- Monitor and troubleshoot data pipelines to ensure they are running smoothly.

- Stay up to date with industry trends and best practices in data engineering.

- Mentor junior data engineers and promote a culture of knowledge sharing.

Skills and Tools Required:

- Strong proficiency in programming languages such as Python, Java, or Scala.

- Extensive experience with SQL and NoSQL databases, including but not limited to PostgreSQL, MySQL, MongoDB, or Cassandra.

- Expertise in data warehousing solutions, such as Amazon Redshift, Google BigQuery, or Snowflake.

- Familiarity with data pipeline orchestration tools like Apache Airflow, Apache NiFi, or Prefect.

- Knowledge of big data technologies such as Hadoop, Spark, or Kafka.

- Understanding of cloud platforms, including AWS, Azure, or Google Cloud.

- Experience with data modeling, data governance, and data security best practices.

- Strong analytical and problem-solving skills, with attention to detail.

- Excellent communication skills and ability to work collaboratively in a team environment.

Join NCSi and be part of a team that values innovation, collaboration, and professional growth. If you are passionate about data engineering and are looking to make an impact, we would love to hear from you.

Roles and Responsibilities

About the Role:

As a Senior Data Engineer at NCSi, you will play a pivotal role in designing and implementing data solutions that enable effective data management and analytics. You will work on building scalable data pipelines and ensuring data integrity across various systems. This position requires a proactive approach to problem-solving and a commitment to optimizing data processes.

About the Team:

You will join a dynamic and collaborative team of data engineers, data analysts, and data scientists at NCSi. The team values innovation and continuous improvement, encouraging knowledge sharing and professional growth. Collaboration with cross-functional teams is key, allowing for diverse perspectives in tackling complex data challenges.

You are Responsible for:

Developing and maintaining robust data pipelines that facilitate the extraction, transformation, and loading (ETL) of data. Implementing best practices for data governance and security while ensuring compliance with industry standards. Collaborating with stakeholders to understand data needs and providing insights that drive business decisions.

To succeed in this role – you should have the following:

Proven experience as a data engineer, with expertise in data modeling, ETL processes, and data warehousing. Strong proficiency in programming languages such as Python or Java and familiarity with SQL. Experience with cloud platforms and big data technologies is a plus, along with excellent communication skills to convey complex ideas effectively.