Senior Engineer, Data Engineering

4 weken geleden

Amsterdam, Noord-Holland, Nederland Tata Consultancy Services Voltijd
Tata Consultancy Services (TCS) is a global leader in IT services, digital, and business solutions that partners with its clients to simplify, strengthen, and transform their businesses. We ensure the highest levels of certainty and satisfaction through a deep-set commitment to our clients, comprehensive industry expertise, and a global network of innovation and delivery centers.

TCS operates on a global scale & has over 6,08,985 of the world's best-trained consultants representing 152 nationalities in 53 countries. TCS established its presence in the Netherlands in 1992 and works with leading Dutch Customers across industry sectors, including several NL20 companies. TCS has been ranked #1 in customer satisfaction, among IT services providers in the Netherlands in a survey by Whitelane Research and is recognized as a Top Employer in the Netherlands, Europe & also Global by the Top Employers Institute

A Data Engineer is responsible for designing, building, and maintaining the infrastructure that enables data collection, storage, and analysis. They work closely with data scientists, analysts, and other engineers to ensure that large datasets are accessible, reliable, and properly structured. Data Engineers play a crucial role in the data pipeline, building systems to acquire, transform, and load (ETL) data for analytics, reporting, and machine learning applications.

Design and Build Data Pipelines:
Develop, construct, test, and maintain data pipelines to extract, transform, and load (ETL) data from various sources to data warehouses or data lakes.
Ensure data pipelines are efficient, scalable, and maintainable, enabling seamless data flow for downstream analysis and modeling.
Work with stakeholders to identify data requirements and implement effective data processing solutions.

Data Integration:
Integrate data from multiple sources such as internal databases, external APIs, third-party vendors, and flat files.
Collaborate with business teams to understand data needs and ensure data is structured properly for reporting and analytics.
Build and optimize data ingestion systems to handle both real-time and batch data processing.

Data Storage and Management:
Design and manage data storage solutions (e.g., relational databases, NoSQL databases, data lakes, cloud storage) that support large-scale data processing.
Implement best practices for data security, backup, and disaster recovery, ensuring that data is safe, recoverable, and complies with relevant regulations.
Data Transformation:
Develop data transformation logic to clean, enrich, and standardize raw data, ensuring it is suitable for analysis.
Implement data transformation frameworks and tools, ensuring they work seamlessly across different data formats and sources.
Ensure the accuracy and integrity of data as it is processed and stored.

Automate repetitive tasks such as data extraction, transformation, and loading to improve pipeline efficiency.
Optimize data processing workflows for performance, reducing processing time and resource consumption.
Troubleshoot and resolve performance bottlenecks in data pipelines.

Collaboration with Data Teams:
Work closely with Data Scientists, Analysts, and business teams to understand data requirements and ensure the correct data is available and accessible.
Assist Data Scientists with preparing datasets for model training and deployment.
Provide technical expertise and support to ensure the integrity and consistency of data across all projects.

Data Quality Assurance:
Implement data validation checks to ensure data accuracy, completeness, and consistency throughout the pipeline.
Develop and enforce data quality standards to detect and resolve data issues before they affect analysis or reporting.
Monitor and improve data quality by identifying areas for improvement and implementing solutions.

Set up monitoring and logging for data pipelines to detect and alert for issues such as failures, data mismatches, or delays.
Perform regular maintenance of data pipelines and storage systems to ensure optimal performance.
Update and improve data systems as required, keeping up with evolving technology and business needs.

Document data pipeline designs, ETL processes, data schemas, and transformation logic for transparency and future reference.
Create reports on the performance and status of data pipelines, identifying areas of improvement or potential issues.
Provide guidance to other teams regarding the usage and structure of data systems.

Stay Updated with Technology Trends:
Continuously evaluate and adopt new tools, technologies, and best practices in data engineering and big data systems.
Participate in industry conferences, webinars, and training to stay current with emerging trends in data engineering and cloud computing.

Bachelor's or Master's degree in Computer Science, Information Technology, Data Engineering, or a related field

Proficiency in programming languages such as Python, Java, or Scala for data processing.
Familiarity with data warehousing solutions (e.g., Apache NiFi, Talend, Informatica, Airflow).
Knowledge of big data technologies (e.g., Experience with cloud platforms (AWS, Azure, Google Cloud) and related services for data storage and processing.
Docker, Kubernetes) for building scalable data systems.
Understanding data modeling concepts (e.g., star schema, snowflake schema) and how they relate to data warehousing and analytics.
Knowledge of data lakes, data warehousing architecture, and how to design efficient and scalable storage solutions.

Strong problem-solving skills with an ability to troubleshoot complex data issues.
Strong attention to detail and a commitment to maintaining data accuracy and integrity.
Ability to work effectively in a collaborative, team-based environment.

3+ years of experience in data engineering, with hands-on experience in building and maintaining data pipelines and systems.
~ Proven track record of implementing data engineering solutions at scale, preferably in large or complex environments.
~ Experience working with data governance, compliance, and security protocols.

Experience with machine learning and preparing data for AI/ML model training.
Certification in cloud platforms (e.g., AWS Certified Big Data – Specialty, Google Cloud Professional Data Engineer).
Experience with DevOps practices and CI/CD pipelines for data systems.
Familiarity with data visualization and reporting tools (e.g., Tableau, Power BI) to support analytics teams

Opportunity to work with state-of-the-art technologies.
Supportive and dynamic team culture

  • Senior Data Engineer

    3 weken geleden

    Amsterdam, Noord-Holland, Nederland ECM Talent Voltijd

    Senior Data Engineer – Python, Dbt,IAC (terraform), SQL 6 month contract + extension long term An excellent opportunity for a Senior Data Engineer to join a globally recognised brand on a minimum 6 month contract + extensions long term Our client need support in building customer domain data products to enable the Data Mesh, including pipelines, data...

  • Senior Data Engineer

    3 weken geleden

    Amsterdam, Noord-Holland, Nederland ECM Talent Voltijd

    Senior Data Engineer – Python, Dbt,IAC (terraform), SQL Start 1st of April 6 month contract + extension long term Location: Amsterdam. Onsite 2-3 days per week An excellent opportunity for a Senior Data Engineer to join a globally recognised brand on a minimum 6 month contract + extensions long term Our client need support in building customer domain...

  • Senior Data Engineer

    4 weken geleden

    Amsterdam, Noord-Holland, Nederland Capital Numbers Voltijd

    We are seeking a Senior Data Engineer to design, build, and optimize scalable data pipelines across PostgreSQL, Amazon S3, and Amazon Redshift. You will play a critical role in expanding our Amazon S3 data lake , optimizing Redshift data models , and ensuring data governance, security, and compliance . Key Responsibilities: Develop and maintain ...

  • Senior Data Engineer

    4 dagen geleden

    Amsterdam, Noord-Holland, Nederland CareerValue Voltijd

    Bedrijfsbeleid: Onze klant, een toonaangevende consultancyorganisatie, ondersteunt uiteenlopende organisaties bij het ontwikkelen en optimaliseren van datagedreven oplossingen. Denk aan het ontsluiten van data, implementeren van complexe algoritmen en de integratie van gegevensbronnen.Beschrijving van de baanAls Senior Data Engineer bij CareerValue werk je...

  • Senior Engineer, Data Engineering

    1 week geleden

    Amsterdam, Noord-Holland, Nederland Poreion Voltijd

    Imagine a company that has been collecting and refining data for more than 12 million vehicles, analysing trends, and transforming raw information into crucial insights that are reshaping the mobility sector. Imagine a database built in over a decade, helping more than 10.000 businesses with technical data, real time analysis and insights into market...

  • Data Engineer

    3 weken geleden

    Amsterdam, Noord-Holland, Nederland Opus Recruitment Solutions Voltijd

    Senior Data Engineer Role - freelance - 9 months - Amsterdam - April start I am seeking a passionate freelance Data Engineer to accelerate digital transformation and drive improved decision-making across Asset Driven Business Areas for an Energy client. We are looking for a contractor who has: Has experience with Analytics & BI tools and services,...

  • Senior Engineer, Data Engineering

    3 weken geleden

    Amsterdam, Noord-Holland, Nederland Brookwood Recruitment Ltd Voltijd

    Freelance Data Engineer – Amsterdam/Manchester/Hybrid – €90 per hour Are you an experienced Data Engineer looking for your next contract opportunity? This is an initial 3-month contract, offering a competitive rate of €90 per hour. As a Data Engineer, you will play a key role in designing and developing data models, ETL workflows, and backend...

  • Senior Data Engineer

    2 weken geleden

    Amsterdam, Noord-Holland, Nederland Vivid Resourcing Voltijd

    My client within the finance space just outside of Amsterdam is looking for a Senior Data Engineer who can help them scale a brand new data platform using the latest Azure stack. You will join an existing team of 3 people and focus on helping the data platform as the business portfolio expands Responsibilities: Collaborate with the Lead Data Engineer and...

  • Senior Engineer, Data Engineering

    2 dagen geleden

    Amsterdam, Noord-Holland, Nederland Global Automotive Group Voltijd

    Bij Global Automotive Group rijden we niet alleen op banden, maar ook op data &##128640; Onze internationale werkmaatschappijen – verspreid over Nederland, Spanje, Zweden, Duitsland en meer – vormen een dynamisch ecosysteem van groothandel, productie, retail en logistiek. Jij kunt hier het verschil maken door synergie te creëren tussen deze...

  • Senior Data Scientist/Engineer/Analyst

    1 week geleden

    Amsterdam, Noord-Holland, Nederland Harnham Voltijd

    Senior Data Engineer / Data Scientist (Azure Databricks) - Global Company Contract Type: Full-time, Permanent We are seeking a highly skilled Senior Data Engineer / Data Scientist with expertise in Azure Databricks to drive our data initiatives and develop scalable solutions that power our analytics and AI-driven insights. Design, develop, and...

  • Senior Azure Data Engineer

    4 weken geleden

    Amsterdam, Noord-Holland, Nederland Status Pro Voltijd

    Wat ga je doen: Werk met impact op financiële stabiliteit en innovatie in data. Bij een toonaangevende financiële instelling speel je een sleutelrol in het ontwikkelen van datamodellen en oplossingen die bijdragen aan een robuust financieel systeem. Deze organisatie heeft haar digitale ambities recent verhoogd en investeert in grote ICT- en...

  • Senior Azure Data Engineer

    1 week geleden

    Amsterdam, Noord-Holland, Nederland Status Pro Voltijd

    Wat ga je doen:Werk met impact op financiële stabiliteit en innovatie in data. Bij een toonaangevende financiële instelling speel je een sleutelrol in het ontwikkelen van datamodellen en oplossingen die bijdragen aan een robuust financieel systeem.Deze organisatie heeft haar digitale ambities recent verhoogd en investeert in grote ICT- en...

  • Senior Azure Data Engineer

    2 weken geleden

    Amsterdam, Noord-Holland, Nederland Status Pro Voltijd

    Wat ga je doen: Werk met impact op financiële stabiliteit en innovatie in data. Bij een toonaangevende financiële instelling speel je een sleutelrol in het ontwikkelen van datamodellen en oplossingen die bijdragen aan een robuust financieel systeem. Deze organisatie heeft haar digitale ambities recent verhoogd en investeert in grote ICT- en...

  • Senior Data Engineer

    3 weken geleden

    Amsterdam, Noord-Holland, Nederland Celebal Technologies Voltijd

    Senior Data Engineer Location: Amsterdam, Netherlands (Hybrid) Duration: Long Term Salary/Rates: Negotiable, DOE Job Description: We are seeking an experienced Data Engineer with 8+ years of experience, and at least 4+ years of expertise in designing and implementing data solutions using the Databricks platform. The ideal candidate will have a solid...

  • Senior Data Engineer/Data Scientist

    1 week geleden

    Amsterdam, Noord-Holland, Nederland Harnham Voltijd

    Senior Data Engineer / Data Scientist (Azure Databricks) – Global Company Location: Amsterdam Salary: Competitive + Excellent Benefits Contract Type: Full-time, Permanent About Us: Join a world-leading global organization at the forefront of innovation and digital transformation. We are seeking a highly skilled Senior Data Engineer / Data Scientist ...

  • Senior Azure Data Engineer

    4 weken geleden

    Amsterdam, Noord-Holland, Nederland Status Pro Voltijd

    Wat ga je doen: Werk met impact op financiële stabiliteit en innovatie in data. Bij een toonaangevende financiële instelling speel je een sleutelrol in het ontwikkelen van datamodellen en oplossingen die bijdragen aan een robuust financieel systeem. Deze organisatie heeft haar digitale ambities recent verhoogd en investeert in grote ICT- en...

  • Senior Engineer, Data Engineering

    2 dagen geleden

    Amsterdam, Noord-Holland, Nederland Then Voltijd

    NextGen is op zoek naar ervaren Data Engineers die klaar zijn voor een volgende stap in hun carrière. Wij vinden dat jij je moet kunnen richten op waar je ambities liggen, namelijk de techniek. Wij helpen je om jezelf te ontwikkelen in de richting die jij ambieert, door samen jouw ideale carrière pad uit te stippelen en daar de beste opdracht voor jou bij...

  • Senior Data Engineer/Scientist

    2 dagen geleden

    Amsterdam, Noord-Holland, Nederland Harnham Voltijd

    Senior Data Engineer / Data Scientist (Azure Databricks) - Global Company Location: Amsterdam Salary: Competitive + Excellent Benefits Contract Type: Full-time, Permanent About Us: Join a world-leading global organization at the forefront of innovation and digital transformation. We are seeking a highly skilled Senior Data Engineer / Data Scientist ...

  • Senior Engineer, Data Engineering

    2 dagen geleden

    Amsterdam, Noord-Holland, Nederland Lekkerland Nederland B.V. Voltijd

    Ben jij de data-expert die wij zoeken? Wil je een sleutelrol spelen in het ontsluiten, bewaken en optimaliseren van data voor strategische besluitvorming? Ontsluiten van bronsystemen en analyseren van IT-applicaties voor geschikte data. Ontwerpen en beheren van efficiënte data pipelines (ETL). Doorvoeren van verbeteringen in data pipelines en processen. ...

  • Senior Data Engineer

    4 dagen geleden

    Amsterdam, Noord-Holland, Nederland Hot ITem Groep Voltijd

    Job DescriptionAls Senior Data Engineer maak je oplossingen die echt impact hebben. Bij ons draait het niet alleen om het inzetten van techniek, maar ook om het begrijpen en benutten van de data zelf. Of je nu een modern datafundament bouwt voor het grootste pretpark van Nederland of voor een ziekenhuis in Amsterdam, door jou kan de klant nog meer waarde uit...