Loading Events

« All Events

  • This event has passed.

Keeping Spark on Track: Best practices using Apache Spark in Production

February 13 @ 4:45 pm - 7:00 pm

This event is catered thanks to the good people @databricks

Miklos Christine is a solutions architect for Databricks where he helps customers deploy and use Apache Spark to build batch and streaming applications. Miklos was previously a systems engineer at Cloudera where he helped strategic customers deploy and use the Apache Hadoop ecosystem in production. He has contributed to several projects in the open source community and holds a BS in electrical engineering and computer sciences from the University of California-Berkeley.

The purpose of this talk is to share best practices learned while developing Apache Spark workflows in production across various industries. Apache Spark is a popular distributed processing framework that allows organizations to analyze multiple streams of data for machine learning and exploratory SQL workloads. I’ll discuss debugging tips, best practices for transforming datasets, and discuss integrating with existing libraries such as numpy and pandas. Code examples will be shared in python.

Details

Date:
February 13
Time:
4:45 pm - 7:00 pm
Event Category:
Website:
https://www.meetup.com/acm-chicago/

Venue

Loyola U. Water Tower Campus Beane Hall (13th fl Lewis Towers): red line to Chicago/State or parking: http://bit.ly/wtcpark
111 E. Pearson Street, Chicago IL 60611
Chicago, IL 60611 us

Organizer

ACM Chicago