Lead Data Engineer @ BUX

Despite the name, it was not my company.

Lead Data Engineer - September 2021 - April 2022

My journey officially advanced as I embraced the role of Lead Data Engineer, an opportunity that marked a significant shift in my career. In this influential role, I undertook responsibilities that included:

  • Strategic Planning: Guiding and overseeing the development of IT solutions within the BI department, with a focus on meticulous planning and supervision.
  • Strategic Decision-Making: Spearheading strategic decisions that influenced the growth, sustainability, and evolution of the organization’s BI architecture at a company-wide level.
  • Vendor Management: Successfully managing relationships with contractors and suppliers, a crucial aspect of outsourcing developments for the organization.
  • Team Management: Orchestrating the development efforts of our team members with a keen Agile approach, ensuring a harmonious and collaborative work environment.
  • Team Member Development: Taking a proactive role in fostering the growth and development of IT team members, enhancing their competencies and experience. This was achieved through the establishment of yearly economic and strategic objectives, measured against clear KPIs.
  • Talent Acquisition: Leading the process of acquiring new team members, meticulously overseeing every step from tech screening to assignment reviews.

Senior Data Engineer - November 2020 - September 2021

My journey commenced with the role of Senior Data Engineer, which laid the foundation for my career progression. In this role, I was entrusted with designing and leading the development of internal software that served customers and various departments of the company. My responsibilities as a Senior Data Engineer included:

  • Infrastructure Excellence: Establishing and maintaining the entire data platform by adopting best practices rooted in Infrastructure-as-Code methodology, while also taking an active role in training the department to implement these patterns in their daily activities, utilizing tools such as Terraform and GCP.
  • Data Pipeline Management: Creating and maintaining data pipelines, including Singer, DBT, and Kafka, which played a critical role in data management and transformation.
  • Data Warehousing: Managing and designing the Data Warehouse solution, including models and ingestion stages, involving DBT, Snowflake, Snowpipe, and Airflow.
  • End-to-End Project Ownership: Taking ownership of data-oriented projects from inception to completion, encompassing requirements, scope, architecture, development, releases, and ongoing maintenance.
  • Data Governance: Contributing to the implementation of data governance and data discoverability within the organization.
  • Supporting Data Scientists: Collaborating with data scientists to run and manage their ML/analytics models in production, ensuring seamless operations.
  • Code Quality Advocacy: Actively advocating for code quality throughout the data team, underscoring the importance of strong software architecture, development best practices, and the incorporation of new technologies.
  • Solution Architecture: As a Solution Architect, I undertook the responsibility of designing suitable, cloud-oriented software architectures for the delivery and deployment of data-based services. These services were intended for use by other company departments and customers.
  • Project Oversight: Tracking and monitoring the software development process, ensuring projects were executed efficiently and met their objectives.
  • CI/CD Pipeline Setup: Setting up CI/CD pipelines for the projects under the team’s governance, enhancing efficiency and automation.

My journey stands as a testament to my capacity for adaptation and my unwavering commitment to success, underscoring my versatile skill set and ability to thrive in roles of increasing responsibility.

Toolkit