Data ingestion, transformation and visualization with Apache NiFi

#hamilton #technical #talk #power #STEM #wie #in-person #SmartCities
Share

As we move towards a data oriented world, it is important for organizations to be able to collect data from multiple sources, apply business logic and transformation and extract intelligence that can help in making better decisions. Data ingestion can be based on real-time streams or batch based data. Apache NiFi is an easy to use reliable system that can be configured to ingest data from various sources, make transformations while handling multiple data formats and send data to downstream applications, dashboards or databases for consumption or display. 

Basically NiFi was built to automate the flow of data between systems and it performs this task very well with a browser based design. We will look at NiFi basics, architecture, data formats, a large number of functions, how it can benefit an organization, integrate data and provide ETL/ELT functionality.



  Date and Time

  Location

  Hosts

  Registration



  • Date: 04 Nov 2024
  • Time: 06:00 PM to 07:30 PM
  • All times are (UTC-05:00) Eastern Time (US & Canada)
  • Add_To_Calendar_icon Add Event to Calendar
  • 1415 Third Line
  • Oakville, Ontario
  • Canada L6M3G2
  • Building: Glen Abbey Community Centre
  • Room Number: Community Room C
  • Click here for Map

  • Contact Event Host
  • Starts 30 September 2024 12:00 AM
  • Ends 04 November 2024 12:00 PM
  • All times are (UTC-05:00) Eastern Time (US & Canada)
  • Admission fee ?


  Speakers

Asaf

Topic:

Data ingestion, transformation and visualization with Apache NiFi

As we move towards a data oriented world, it is important for organizations to be able to collect data from multiple sources, apply business logic and transformation and extract intelligence that can help in making better decisions. Data ingestion can be based on real-time streams or batch based data. Apache NiFi is an easy to use reliable system that can be configured to ingest data from various sources, make transformations while handling multiple data formats and send data to downstream applications, dashboards or databases for consumption or display. 

Basically NiFi was built to automate the flow of data between systems and it performs this task very well with a browser based design. We will look at NiFi basics, architecture, data formats, a large number of functions, how it can benefit an organization, integrate data and provide ETL/ELT functionality.

Biography:

A bachelors in Electrical Engineering from NEDUET, Pakistan and a masters in Computer Engineering from KFUPM, KSA. Working in the IT industry as an architect, consultant, and IT trainer with experience in data center, virtualization, infrastructure and project management. 

Currently, working with IBM Canada as an Azure Cloud Solutions Architect advising leading companies on application modernization and designing hybrid cloud solutions. 

Asaf has also worked as an instructor at Humber (2012-2021) where he taught hundreds of students under the Ontario Bridging program, during this period, developed 1000+ slides as course material for VMware vSphere 6.x training.

Previously worked for CGI, BMO, Telus and VMware. Had also worked as a consultant with the government of Canada at SSC, Canada Correctional Service among others.

Member of both IEEE and ACM for 20+ years. In hid spare time, he love travelling, read books, eat out and enjoy the outdoors gatherings with friend and family.

Asaf can be contacted on LinkedIn: https://www.linkedin.com/in/asafmaruf/

Email:

Address:Oakville, Canada





Agenda

6:00PM - Introduction of IEEE Hamilton Section

6:15PM - Presentation

7:15PM - Q&A

7:30PM - Refreshments