Etsy Code as Craft events are a semi-monthly series of guest speakers who explore a technical topic or computing trend, sharing both conceptual ideas and practical advice. All talks will take place at the Etsytorium on the 6th floor at 55 Prospect Street in beautiful Brooklyn. Come see an awesome speaker and enjoy food, drinks, and friends. We hope to see you at an upcoming event!
On May 22, 2019, Keyur Govande, Etsy’s Chief Architect, will speak at our Brooklyn office to talk about Etsy’s migration from our on-premises datacenter to Google Cloud. He’ll share strategies for doing so, surprises along the way, and reflect on what’s next for Etsy’s monolith.
The talk will also be live-streamed at 7pm Eastern.
Migrating Our Monolith to the Cloud
After over a decade of hosting itself in the data center, Etsy.com moved to the Google Cloud Platform (GCP) in 2018. In this talk, Keyur Govande will discuss:
- Why Etsy decided to make the transition;
- Architectural strategies for migrating a large monolith, and the difficulties faced gaining confidence in them;
- Assumptions we never knew about and had to fix: in the application code, the infrastructure tooling, and our processes;
- How we cut over to GCP safely;
- What we’ve since learnt, nine months post-cutover;
- What’s next for the monolith.
About Keyur Govande
Keyur is the Chief Architect at Etsy. He has led multiple large architectural changes during his tenure, most recently the move to Google Cloud. Prior to this role, he was a key member of the Systems Engineering team helping scale the site and keeping PHP, Gearman, MySQL, Memcached, Redis, and the Linux kernel running smoothly.
On February 28, 2019, Martin Fowler will join us at our Brooklyn office to talk about modern strategies for designing-and iterating- software systems.
The talk will also be live-streamed at 7pm Eastern.
Software Design in the 21st Century
In the last decade or so we’ve seen a number of new ideas added to the mix to help us effectively design our software. Patterns help us capture the solutions and rationale for using them. Refactoring allows us to alter the design of a system after the code is written. Agile methods, in particular Extreme Programming, give us a highly iterative and evolutionary approach which is particularly well suited to changing requirements and environments. Martin Fowler has been a leading voice in these techniques and will give a suite of short talks featuring various aspects of how these and other developments affect our software development.
About Martin Fowler
I’m an author, speaker, consultant and general loud-mouth on software development. I concentrate on designing enterprise software – looking at what makes a good design and what practices are needed to come up with good design. I’ve been a pioneer of various topics around object-oriented technology and agile methods, and written several books including “Refactoring”, “UML Distilled”, “Patterns of Enterprise Application Architecture”. For the last decade I’ve worked at ThoughtWorks, a really rather good system delivery and consulting firm, and I write at http://martinfowler.com.
On November 13, 2018 Etsy’s own Rasmus Lerdorf will join us at our Brooklyn office to speak about the current state of PHP.
The talk will also be live-streamed at 7pm Eastern.
PHP in 2018
This talk will provide a look at the current state of PHP. Join us to hear about the history of PHP until this point, what’s new in 7.3, and an overview of some exciting new features in the recent version: performance, compiler optimizations, static analysis, and a cool new low-overhead profiler.
About Rasmus Lerdorf
Rasmus Lerdorf is known for having gotten the PHP project off the ground in 1995 and has contributed to a number of other open source projects over the years. He was an infrastructure architect at Yahoo! for more than 7 years and joined Etsy in 2012.
He was born in Greenland, grew up in Denmark and Canada and has a Systems Design engineering degree from the University of Waterloo. You can follow @rasmus on Twitter.
On August 21, 2018 Liz Fong-Jones will join us at our Brooklyn office to speak about service-level objectives and error budgets.
The talk will also be live-streamed at 7pm Eastern.
Adopting SRE and Error Budgets
Service level objectives and error budgets are the cornerstone of site reliability engineering and a critical tool for organizations to find an appropriate balance between reliability and rates of feature development. This talk is an introduction to bringing SRE practices into your organization — who to hire, how to organize, what projects to work on, how to measure reliability, how to assess reliability risks, and how to make longer-term changes to development priorities if your error budget is overspent or underspent.
About Liz Fong-Jones
Liz is a Staff Site Reliability Engineer at Google and works on the Google Cloud Customer Reliability Engineering team in New York. She has worked across 8 different teams spanning the stack from Google Flights to Cloud Bigtable in her 10+ years at Google. She lives with her wife, metamour, and a Samoyed/Golden Retriever mix in Brooklyn. In her spare time, she plays classical piano, leads an EVE Online alliance, and advocates for transgender rights.
On June 12, 2018 Kent Beck will join us at our Brooklyn office to speak about parititioning software development into three phases: Exploration, Expansion, and Extraction.
The talk will also be live-streamed at 7pm Eastern.
You wouldn’t play soccer with rugby strategy or apply football strategies to rugby. The rules of each game and the strategy for playing go hand in hand.
Software developers have spent decades searching for the right way to develop software. We are no closer to finding answers to whether we should have estimate the cost of work, refactor, or even collaborate closely.
Kent Beck’s 3X model organizes software development into three phases:
- Explore, where quick experiments are launched to find a growth loop;
- Expand, focused on removing the barriers to growth;
- Extract, deriving value from a successful system to fund further growth.
This talk will introduce 3X Explore/Expand/Extract, discuss how the phases are different, and present the ultimate challenge: running projects in all three phases at the same time.
About Kent Beck
Kent Beck has been a programmer for 45 years. He pioneered software patterns, test-driven development, the xUnit family of testing frameworks, Extreme Programming, and he is alphabetically the first signatory of the Agile Manifesto. Most recently he spent 7 years coaching engineers at Facebook. Now independent, his focus is storytelling, collaborative development, quantitative studies of software engineering, art, singing and guitar, writing, and proselytizing cheese making. Well, perhaps “focus” is the wrong word.
On April 10, 2018 Camille Fournier will join us at our Brooklyn office to speak about her book, The Manager’s Path.
The talk will also be live-streamed at 7pm Eastern.
A Guide for Tech Leaders Navigating Growth and Change
Whether you’re starting out in technology or have 20 years of experience managing managers, Camille provides clear descriptions for what to expect and advice for how to handle it at every stage of professional development along a technology-focused career track.
About Camille Fournier
Camille Fournier is the head of Platform Engineering at Two Sigma, a financial company in New York City. Prior to joining Two Sigma she was the Chief Technology Officer of Rent the Runway, a transformative brand that offers unprecedented access to designer fashion, disrupting the way millions of women get dressed. She is an open source contributor and project committee member for both Apache ZooKeeper and the Dropwizard web framework. Prior to working for Rent the Runway, Camille served as a software engineer at Microsoft, and most recently, spent several years as a technical specialist at Goldman Sachs, creating distributed systems for managing risk analysis and firmwide infrastructure.
She has a BS in Computer Science from Carnegie Mellon University and an MS in Computer Science from the University of Wisconsin-Madison. Camille is a well-respected voice within the tech community, speaking on a variety of topics such as engineering leadership, distributed systems, scaling teams, and technical architecture. In 2017 she released her book, “The Manager’s Path: A Guide for Tech Leaders Navigating Growth and Change.”
On February 26, 2018 Cathy O’Neil will join us to speak about her book, Weapons of Math Destruction.
Weapons of Math Destruction
We live in the age of the algorithm. Increasingly, the decisions that affect our lives—where we go to school, whether we get a car loan, how much we pay for health insurance—are being made not by humans, but by mathematical models. In theory, this should lead to greater fairness: Everyone is judged according to the same rules, and bias is eliminated.
But as Cathy O’Neil reveals, the opposite is true. The models being used today are opaque, unregulated, and uncontestable, even when they’re wrong. Most troubling, they reinforce discrimination: If a poor student can’t get a loan because a lending model deems him too risky (by virtue of his zip code), he’s then cut off from the kind of education that could pull him out of poverty, and a vicious spiral ensues. Models are propping up the lucky and punishing the downtrodden, creating a “toxic cocktail for democracy.” Welcome to the dark side of Big Data.
O’Neil exposes the black box models that shape our future, both as individuals and as a society. These “weapons of math destruction” score teachers and students, sort résumés, grant (or deny) loans, evaluate workers, target voters, set parole, and monitor our health.
O’Neil calls on modelers to take more responsibility for their algorithms and on policy makers to regulate their use. But in the end, it’s up to us to become more savvy about the models that govern our lives. Her talk will empower us to ask the tough questions, uncover the truth, and demand change.
About Cathy O’Neil
Cathy O’Neil is the author of the New York Times bestselling Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy, which was also a semifinalist for the National Book Award.
She earned a Ph.D. in math from Harvard, was a postdoctoral fellow in the MIT math department, and a professor at Barnard College where she published a number of research papers in arithmetic algebraic geometry. She then switched over to the private sector, working as a quantitative analyst for the hedge fund D.E. Shaw in the middle of the credit crisis, and then for RiskMetrics, a risk software company that assesses risk for the holdings of hedge funds and banks. She left finance in 2011 and started working as a data scientist in the New York start-up scene, building models that predicted people’s purchases and clicks.
Cathy wrote Doing Data Science in 2013 and launched the Lede Program in Data Journalism at Columbia in 2014. She is a columnist for Bloomberg View.
How Live Coding Made Me a Better Developer
Live coding seems like an awful punishment to put yourself through! However it can be a really effective form of communication for yourself and other developers to benefit from. Do people really watch live streams of developers working? Won’t everyone see your mistakes and broken code? What the heck is Twitch anyway?
Join Suz Hinton as she talks candidly about her experiences live coding regularly for the past year and beyond. She’ll cover how it helped her improve multiple skillsets as a developer, and the impact it has had on a more personal level.
About Suz Hinton
Suz Hinton works in developer relations at Microsoft. Prior to her current role, Suz was a frontend developer for 10+ years. She’s an avid open source contributor, writing and collaborating on libraries relating to topics such as NodeJS robotics, accessibility, and creative coding.
Women & Non-Binary People in Tech (“WomEnby-Tech” for short) is a group for women and non-binary folks in tech at Etsy with a mission to empower, promote, and connect women and non-binary people at Etsy who are interested in technology.
Join us for a series of lightning talks related to technology, entrepreneurship, product development, and design. Each speaker will present for ~5 minutes followed by a group Q&A.
Stefanie Schirmer — OMG building a shell in 5 minutes
A shell is the shortest connection to talk to your operating system and its kernel. We can execute processes in it, and spawn them as child processes for simple multitasking. Some of us may have had to write a minimal self-made shell as an exercise in school; here we will attempt to build one in just 5 minutes. Let’s try it!
Jessica Harllee — Encouraging designers to craft code
At Etsy, designers are empowered to push code and collaborate directly with engineers. Hear a few of the ways we make it easy for designers to be a part of the process.
Devina Dhawan — Amazon Web Services at Etsy
Amazon Web Services is used for major backups here at Etsy and we spent a lot of time last year tidying it up so we can have more effective usage of this service. Come learn how Etsy uses these services and how we encourage our teams to support them.
Katrina Walser — Knitters are Human Compilers
People who knit have a very similar function to compilers – they execute well-formed instructions to create something useable. Come find out more, and how knitting patterns translate really easily into computer programs!
Ayla Myers — Generating Images with Wave Function Collapse
There are a lot of ways to get computers to do some pretty clever things: neural networks, markov chains, etc. I will share a technique I found for generating images that takes inspiration from quantum mechanics.
Alex Daud — Etsy AV & Code As Craft
As an AV Engineer at Etsy, Alex Daud has worked behind the scenes at several Code As Craft events. Find out what audiovisual solutions bring Code As Craft to life, both in person and streamed online, and trace the signal flow from the person at the podium to the published video on YouTube.
February 7, 2017: Omoju Miller -- What really makes a coder? A machine learning approach to the tech pipeline
There is a myth in technology that talent stems from innate ability. Really though it’s a process of learning and hard work.
As seen through history, technology can destabilize the jobs market. This begs the question: what are truck drivers going to do in the age of driverless cars? Omoju Miller’s work puts forward the idea that we can scale adult technical education for workforce readiness while leveraging that opportunity to equalize participation. In her doctoral work at Berkeley she’s taken a machine learning approach into understanding why students choose Computer Science.
Why should you come to this talk?
- Learn how data-driven approaches can be used to confront very thorny social issues
- Get a unique view into the how and why of machine learning
Why should you care?
- You can make informed decisions about what to fund when you approach education funding
- A talented workforce begins in the classroom
Read more about this work here:
- The Myth of Innate Ability in Tech
- CSExperiencePrediction: Part One, Two Birds with One Stone
- CSExperiencePrediction: Part Two
About Omoju Miller
Omoju Miller is a Data Scientist with over a decade of experience in computational intelligence. She has a Ph.D. from UC Berkeley. In the past, she has co-led the non-profit investment in Computer Science Education for Google and served as a volunteer advisor to the Obama administration’s White House Presidential Innovation Fellows. She is considered one of the folks to watch, as part of Bloomberg’s Beta Future Founders program.
In our work, we each have moments of saying some prepared words under a spotlight – whether it’s during team standups, giving a presentation at a meeting, or pitching your promotion to your boss – and yet we all have different fears about those moments. Whether your speciality is coding, design, or community, strong communication skills will take your technical expertise to the next level. In this talk, we’ll walk through the spectrum of public speaking fears and learn tactics to address them, so you can feel confident and equipped to step into the spotlight.
About Lara Hogan
Lara Hogan is an Engineering Director of Product Infrastructure at Etsy and the author of Designing for Performance, Building a Device Lab, and Demystifying Public Speaking. In her world tour to advocate performance to designers and developers alike, Lara has presented at Google I/O, keynoted the Velocity Conference, and given talks at companies like The New York Times to help shift them toward a culture of performance. She’s a master at breaking down technical topics in ways that help people understand and trust her advocacy. Previously at Etsy, Lara was the Engineering Manager of Mobile Web.
MySQL is at the core of Facebook’s persistent storage. The graph itself, including every like, comment, post and status, is stored in MySQL, along with many other things. This data is the company’s most important asset, and we take great care to make sure everything is properly backed up. Yes, even the lol cats and puppy picture posts. Everything!
As you can imagine, backing up this behemoth of a dataset is quite a challenge.
The backup system Facebook runs for MySQL is multi-tiered and massively distributed. We employ binary log, full, and differential backups and clever hacks to balance speed, space and reliability.
In this talk you’ll learn how we backup Facebook, every single day. We’ll go over the design, engineering and operational challenges we’ve had to overcome, and wrap up with some fun war stories.
About Shlomo Priymak
Shlomo has been on the MySQL Infrastructure team at Facebook since 2011, managing one of the biggest MySQL clusters in the world — mostly by being lazy and making automation manage it instead of him.
Before making the switch to manage 1000s of MySQL servers, Shlomo was pretty happy with 100s of them at companies like Sears and Wix, where he was a DBA and a developer.
Prior to diving into to the MySQL world in 2006, Shlomo used to be a SQL Server DBA at the Israeli Intelligence Corps, but he can’t tell you how many servers he managed there.
It’s early days for mobile app delivery and operations. The tools and methods are still developing and detailed technical stories are hard to find. We believe we need to start talking about the complete mobile delivery story. Through speakers, lightning talks, and ad hoc discussions we’ll be talking about topics like
- Test automation
- Continuous integration
- Beta testing
- Business metrics
- A/B testing
- Performance monitoring
- Network optimization
- And more…
Talks will take place over two days, March 21st and 22nd. For a detailed schedule click here.
Modern Application Security for iOS
iOS applications have become an increasingly popular targets for hackers, reverse engineers, and software pirates. In this presentation, we discuss the current state of iOS attacks, review available security APIs, and reveal why they are not enough to defend against known threats. For high-risk applications, novel protections that go beyond those offered by Apple are required. As a solution, we discuss the design of the Mobile Application Security Toolkit (MAST) which ties together jailbreak detection, anti-debugging, and anti-reversing in LLVM to address these risks.
About Sophia D’Antoine
Sophia D’Antoine is a security engineer at Trail of Bits and a recent graduate of Rensselaer Polytechnic Institute. She is a regular speaker at security conferences around the world, including RECon, Blackhat, and Hack.lu. Her present work includes techniques for side channel attacks, automated software exploitation, and software obfuscation with LLVM.
With up to 5 companies vying for every available software developer and 38% of developers reporting that they receive recruiter emails at least once a week, programmers have never been more in demand, and tech companies continue to expand their benefits and perks to try and stand out. But what really works? What do developers really care about? Join Etsy CTO John Allspaw in conversation with Joel Spolsky, the CEO of Stack Overflow, co-founder of Fog Creek Software and creator of Trello, to learn what developers look for in a great workplace and what employers can do to retain top talent.
About Joel Spolsky
Joel Spolsky is the Co-Founder & CEO of Stack Exchange, the largest network of websites for software developers including Stack Overflow. Joel is a globally recognized expert on software development and is known by developers around the world for his website, Joel on Software.
In 2000, he founded his first company, Fog Creek Software, which creates project management tools for software developers. Fog Creek recently spun out Trello, a web based project management tool with applications for anything from product development to home renovations to wedding planning. Previously, Joel worked at Microsoft, where he designed VBA as a member of the Excel team, and at Juno Online Services where he developed an Internet client used by millions.
He has written three books, including Smart and Gets Things Done: Joel Spolsky’s Concise Guide to Finding the Best Technical Talent (Apress, 2007) and worked as a contributing editor for Inc. Joel graduated from Yale University with a degree in Computer Science. Before college, he served in the Israeli Defense Forces as a paratrooper and helped found Kibbutz Hanaton.
About John Allspaw
John Allspaw is Etsy’s Chief Technology Officer (CTO), leading the Product Engineering, Infrastructure and Operations teams. Previously, he was SVP of Infrastructure and Operations at Etsy. For over 17 years, he has worked in system operations in the biotech, government and online media industries.
He began his career running vehicle crash simulations for the U.S. government. In 1997, he made the leap to the web, building the technical infrastructures at Salon, InfoWorld, Friendster and Flickr.
John is the author of The Art of Capacity Planning and Web Operations: Keeping the Data On Time, both published by O’Reilly Media. He holds a BS from the University of Massachusetts, Amherst, and an MSC from Lund University.
Deploying PHP 7
PHP 7 is here and it brings drastic performance improvements along with a number of cool new features. Learn how PHP 7 is likely to impact your application and how to identify potential backward compatibility breaks. Now would also be a good time to revisit your deploy strategy to make sure it is safe, efficient and atomic and makes use of the latest features of PHP 7.
About Rasmus Lerdorf
Rasmus Lerdorf is known for having gotten the PHP project off the ground in 1995 and has contributed to a number of other open source projects over the years. He was an infrastructure architect at Yahoo! for more than 7 years and most recently has been advising startups including WePay, Etsy, and Room77. He was born in Greenland, grew up in Denmark and Canada and has a Systems Design engineering degree from the University of Waterloo. Follow @rasmus on Twitter.
Stefan Priebsch: The Five Rules of PHP Craftsmanship
PHP gives developers a great deal of freedom to achieve their goals. In larger-scale projects, PHP also provides you with a lot of rope to hang yourself with, and short cycles of rapid development can quickly turn into years of maintenance nightmare. We will discuss five rules that every PHP developer and aspiring craftsman should know and stick to.
Sebastian Bergmann: PHP 7, PHPUnit 5, and Beyond
Every eight weeks a new version of PHPUnit that adds new functionality is released. These releases do not break backwards compatibility, making it easy for developers to update. The October 2015 release, PHPUnit 5.0, however, needs to break backwards compatibility to prepare PHPUnit for PHP 7. We will discuss how PHPUnit had to be adapted for PHP 7, how PHPUnit benefits from PHP 7, what additional changes PHPUnit 5 brings with it, and we’ll close with a look ahead to PHPUnit 6.
About Stefan Priebsch
Stefan Priebsch, co-founder and principal consultant of thePHP.cc, helps teams to successfully develop sustainable software. He is a consultant, trainer, book author, university lecturer, and last but not least a proven scalability expert, being the father of five year old twins.
About Sebastian Bergmann
Sebastian Bergmann, co-founder and principal consultant of thePHP.cc, helps teams to successfully test their software. He is a consultant, trainer, book author, and develops Open Source tools such as PHPUnit to make PHP a reliable platform for large-scale, critical projects.
What happens if you take everything that is happening in your company — every click, every database change, every application log — and make it all available as a real-time stream of well structured data?
Jay will discuss the experience at LinkedIn and elsewhere moving from batch-oriented ETL to real-time streams using Apache Kafka. He’ll talk about how the design and implementation of Kafka was driven by this goal of acting as a real-time platform for event data. Jay will cover some of the challenges of scaling Kafka to hundreds of billions of events per day at Linkedin, supporting thousands of engineers, applications, and data systems in a self-service fashion.
He’ll describe how real-time streams can become the source of ETL into Hadoop or a relational data warehouse, and how real-time data can supplement the role of batch-oriented analytics in Hadoop or a traditional data warehouse.
Jay will also describe how applications and stream processing systems such as Storm, Spark, or Samza can make use of these feeds for sophisticated real-time data processing as events occur.
About Jay Kreps
Jay Kreps is the CEO of Confluent, a company focused on building a real-time stream platform around Apache Kafka. Previously, he was one of the primary architects for LinkedIn where he focused on data infrastructure and data-driven products. He was among the original authors of a number of open source projects in the big data space, including Voldemort, Kafka, and Samza.
Framer is a prototyping tool that uses code to make anything possible. This talk is about code as a design tool and prototyping in general.
About Koen Bok
Koen founded Sofa, a small design agency based in Amsterdam in 2006. Sofa won 2 Apple design awards for their retail and developer products, Checkout and Versions. In 2011 this led to an acquisition by Facebook. He worked at Facebook as a product designer and worked on Messenger and Ads until 2013. Early 2014, he founded Framer with Jorn van Dijk.
We build amazing applications, wondrous contraptions that are helping people to solve problems and MAKE THINGS BETTER. We are doing this at a record pace, with new code pushed to production servers frequently and by many individual developers. And we are doing this on the Internet, an evil place filled with terrible people who want to do our beautiful code creations harm?
Oh dear, so what now?
Buy a CYBER device or six? Hire a specialist team of ex-hackers? Purchase insurance?
Lol. Let’s face it; this approach hasn’t worked for the last 20 years. Let’s stop wasting time and money and start surviving.
Based on a career working with some of the most dynamic and fast moving organizations we could find, let us show you how to throw out the security rule book and bring continuous, survival focused security to your world (no matter how big or small that world is).
About Laura Bell
Laura Bell is an application security specialist. A reformed software developer and penetration tester she has spent most of the past decade doing bad things to nice people’s code. Now she runs SafeStack, a specialist security firm that aims to help fast moving developers like you protect themselves and their creations online from people like her.
Laura has spoken at a range of events such as BlackHat, Velocity, OSCON, Kiwicon, Linux Conf AU, and Microsoft TechEd on the subjects of privacy, covert communications, agile security, and security mindset. She tweets from time to time as @lady_nerd.
An amateur python developer, known troublemaker and occasional gamer, Laura lives in Auckland, New Zealand with her husband and daughter.
Minimum Viable Bureaucracy
As your team grows and your projects become more complex, you’re going to need a certain amount of process. In this talk Laura will explain how to add enough engineering management to be effective without driving engineers crazy.
- Basics of chaordic systems (or: how open source projects succeed without project management)
- Building trust and preserving autonomy
- Effective communication practices for IRC, email, and bugs
- The meetings you have to have, and the ones you should avoid
- Architecture design and problem solving in a less-structured environment
- Minimum viable documentation
- Goals, scheduling, and anti-estimation
- Shipping and managing scope creep and perfectionism
- How to lead instead of merely managing
- Emergent process and how to iterate
About Laura Thomson
Laura Thomson is the Director of Engineering, Cloud Services Engineering and Operations at Mozilla, where she leads engineering teams responsible for the development, operations, quality assurance, and security of Mozilla web applications and cloud services. She has been in various engineering roles at Mozilla for the last seven years, and previously worked in jobs including Principal/VP at OmniTI, web developer, consultant, and computer science academic. Nagios sends her more email than her friends do, and she spends more time looking at graphs than pictures of her family. She has written several books on various Open Source technologies, and is trying to speak at fewer conferences. Laura lives with her family on a rustic horse farm in Maryland, where she relaxes by indulging in manual labor and other rural pursuits.
Proof in Functions
A programming language with a sufficiently advanced type system allows us to explore a beautiful idea that straddles the line between mathematics and computer science. The type system can be used to prove mathematical theorems. We’ll use Apple’s new language, Swift, and interactive playgrounds to explore this idea and come face-to-face with the strange fact that sometimes the compiler can write our code for us.
About Brandon Williams
Brandon Williams is a mathematician that works as an engineer at Kickstarter. He’s worked primarily on iOS for the past 3 and a half years, but also contributed to discovery and mobile for the website.
May 27, 2015: Kamelia Aryafar and Jerry Soung - Looking Through Camera Lenses: The Application of Computer Vision at Etsy
Looking through Camera Lenses: Computer Vision and its Applications in Etsy
Online retail is a visual experience – shoppers have particular styles that they find appealing; often images are used as first order information when making shopping decisions. There are a variety of signals extracted from the images representing those items for sale by shoppers. Amongst these, color composition, image features and various quality scores serve as important cues for visual search and image ranking. Often shoppers have a palette of favorite colors, or a mental image of what they’re looking for. Moreover, images can be used to extract meaningful information for security applications such as duplicate and tamper detection.
In this talk, we present a review of the state-of-the-art mathematical models for image processing including feature and signatures extraction, matching and classification for tag recommendation, search by color and duplicate detection among other applications. We introduce the applications of these technologies at Etsy and discuss our experience and challenges integrating these technologies with our existing models.
About Kamelia Aryafar
Kamelia is a data scientist at Etsy working for the past two years with machine learning models and computer vision tools to curate a personalized experience for users. Prior to Etsy, Kamelia was a Ph.D. student at Drexel University working on machine learning techniques for information retrieval from large-scale music data sets.
About Jerry Soung
Jerry is a staff engineer with Etsy’s Risk Engineering team. He has been with Etsy for more than four years. He is the primary developer behind SCRAM — Etsy’s internal tool for detecting fraud, abuse, and policy violations in the marketplace. Recently, he’s extended this tool, working closely with the Data Science team to incorporate machine learning and other advanced techniques into the SCRAM detection repertoire.
Building Smart & Opinionated Security Warnings
SSL is supposed to protect your e-mail, Tweets, and bank records from network
attackers. Most of the time, SSL keeps your data safe — but sometimes the SSL
connection setup fails. When this happens, your browser will warn you about the
risk and ask you what to do. These warnings are problematic because often
neither the browser nor the user knows whether the error indicates a real
attack. Chrome’s security team is tackling this problem by building smarter and
more opinionated warnings. I’ll talk about both challenges: first, how we’re
using design techniques to make our UI more convincing; and second, how we’re
combining client and crawler data to improve warning accuracy.
About Adrienne Porter Felt
Adrienne Porter Felt is a software engineer on the Chrome security team, where
she is the tech lead for Chrome usable security. In this role, she works on
improving how and when Chrome presents security information. Recently, she’s
focused on promoting the adoption of HTTPS and reducing the rate of HTTPS
misconfigurations. Previously, Adrienne was a research scientist on the Google
security research team. Adrienne received a PhD in computer science from UC
Berkeley. As a graduate student, Adrienne was a Facebook fellow and Anita Borg
Every Problem is a Scaling Problem
When I joined Twitter, it was a 50ish person company. When I left, I had 400 people reporting to me alone globally. Developing “Twitter scale” infrastructure and slaying the fail whale is usually what most people talk about — but what about the lessons learned operating a team at scale?
About Raffi Krikorian
Raffi was, until August 2014, Twitter’s VP of Engineering in charge of the Platform, the core infrastructure of Twitter. He managed 400 people who worked on, amongst other things, the business logic, the scalable services, APIs, storage, core libraries, and the internal development model of all of Twitter.
Before Twitter he used to create technologies to help people frame their personal energy consumption against global energy production (Wattzon – Business Week’s “Best Idea” 2008), fueled his television habit through writing “TiVo Hacks” (O’Reilly, August 2003), and also ran a consulting company building off-the-wall projects. At one point, he also used to teach at NYU’s ITP (created the class Every Bit You Make) and spent way too much time as a student at MIT and the MIT Media Lab (Internet 0 – Scientific American September 2004).
The Past, Present, and Future of Responsive Images
The goal of a “responsive images” solution is to deliver an image ideally suited to the end user’s ever-changing context, rather than serving the largest potentially necessary image to everyone. Unfortunately, this hasn’t proven to be quite so simple in practice as it seems to be in theory. Small screens should get smaller images, sure, and large screens should get larger ones. Naturally, only high-resolution displays should qualify for high-resolution images, but what if that user has limited bandwidth available? Would the low-resolution image be preferable—and at what point? Explore the path to a standardized solution, look at some of the proposals that will be shaping our future work; and learn techniques we can use to start saving our users’ bandwidth today.
About Mat Marquis
Mat “Wilto” Marquis works at Bocoup; formerly Filament Group. Mat is technical editor and contributor at A List Apart, Chair of the Responsive Images Community Group and an editor on the W3C HTML5.1 specification.
He guesses this is all pretty cool, but he is still most proud of having finished Mega Man 2 for the NES—on “difficult”—without losing a life.
The role of the product organization is to consistently deliver significant new value to the business through continuous product innovation. Yet most teams don’t deliver that value. They just make minor optimizations to existing products. Or they continue to toss more features onto the pile. Further, most people that talk about innovation do so in the context of a new startup, but in existing businesses there are significant additional challenges as in order to innovate we must do our discovery work in ways that protect our brand, our revenue, our employees and our customers. In this talk I will describe the critical cultural and process changes necessary for your organization to continuously and consistently deliver the value your company and your customers need.
About Marty Cagan
Marty Cagan is the Founder of the Silicon Valley Product Group, where he works with and advises many of the leading technology teams in the world. Before founding SVPG to pursue his interests in helping others create successful products through his writing, speaking, investing and advising, Marty was most recently the original SVP of Product and Design for eBay, where he was responsible for creating and building the product and design organizations and defining the products and services for the company’s global e-commerce trading site. Marty began his career working for 10 years as a software developer at HP Labs, and then moved on to join a young Netscape Communications as their VP Platform and Tools. Marty is the author of INSPIRED: How To Create Products Customers Love, and publishes a popular blog for product teams at www.svpg.com.
Or, How Etsy Tested 14 Versions of their Listing Page on the Road to Shipping the Largest Experimental Win in Their History.
In Giovanni’s own words, “You want to throw out all the code. You want to make a brand new thing. You will probably fail. Come hear about how we failed not once, but more than a dozen times. Come hear about why we’re doing it, again.”
About Giovanni Kincade
Gio is a product engineer on the Buyer Experience team at Etsy, focusing on the Shop and Listing Page experiences. He spent many years working on Search and Search Infrastructure, and in a prior life was a Product Manager and amateur DBA.
Using Node.js and Computer Vision techniques John has been building tools and libraries to analyze Japanese art and art data. In this talk he will dig into the history of Japanese woodblock printing and the tools that he’s built and how they’ve been helping art historians, researchers, and collectors better understand all the data that they deal with.
About John Resig
John is a Visiting Researcher at Ritsumeikan University in Kyoto working on the study of Ukiyo-e (Japanese Woodblock printing). He has developed a comprehensive woodblock print database and image search engine located at: Ukiyo-e.org.
Open Source has radically changed the way that companies do software development. We used to live in a world where each company re-built everything from scratch, but openness has allowed us to collaborate on common components, reducing duplication and driving down costs. Can we apply these same lessons to other areas? Balanced thinks so. In this talk, Steve will talk about the “Open Company Initiative,” which applies similar kinds of openness to product development, pricing, and other business practices that are traditionally fully closed. He’ll also show an example of how this openness actually changed some of the code Balanced has written.
About Steve Klabnik
Steve is a prolific Open Source contributor, member of the Ruby on Rails team, and Balanced’s philosopher in residence. He’s the author of several books: “Designing Hypermedia APIs,” “Rails 4 in Action,” and “Rust for Rubyists.
Join us as Marcus and Laurie reprise their highly acclaimed talk first presented at Velocity Europe.
Relying on a single content delivery network for your site can impose a number of flexibility limitations. By diversifying your CDN providers you can put the power back in your hands, allowing you to get the best of both worlds in terms of performance, reliability and cost. In this talk Marcus and Laurie will present Etsy’s recent work integrating multiple CDN providers to their site delivery infrastructure.
Building web sites and applications is a pursuit where we learn a great deal and can be reasonably successful in a very short period of time. But to become true masters of our craft, we investigate subtleties and nuance in an effort to perfect our work, aiming for constant improvement. We specialize in areas of performance, scalability, maintenance and more. It is part of what we do as dedicated professionals who are committed to our craft. Accessibility is one of many areas where details matter.
In this talk, Derek will guide you through a tour of design and development decisions that we make that ultimately play a significant role on the utility of an interface – more significant than we think. You’ll see examples that will help you question standard practice and convention as you see first hand the impact our decisions make.
About Derek Featherstone
Derek Featherstone is an internationally-known speaker and authority on accessibility, inclusive design, user experience and web development. He is the lead of Simply Accessible Inc., a leading firm that delivers insightful and creative accessibility consulting to Fortune 500 corporations, educational institutions, public utilities, government agencies and other private sector clients.
Oh, the elusiveness of “One Web”. And yet, increasingly users treat the web as one experience — add a product to your cart from your phone during the morning commute, and finish the transaction in the afternoon at work from your desktop computer. This discussion examines what’s required to present a consistent, delightful experience to users regardless of where the experience begins, continues, and ends. You’ll learn to avoid development mistakes committed by even the most seasoned among us, and you’ll see plenty of examples from teams big and small doing it right.
About Cameron Moll
Cameron Moll is the founder of Authentic Jobs, a targeted job board for web and creative professionals. He’s the co-author of the best-selling CSS Mastery (2006, 2009) and author of Mobile Web Design (2007), a self-published title. Cameron’s work or advice has been featured by HOW, Communication Arts, PRINT, Forrester Research, National Public Radio (NPR), and many others. One of his letterpress type posters, the most recent of which can be seen at ColosseoType.com, was the recipient of the HOW 2008 In-House Design Award. Cameron resides in Sarasota, Florida, with his wife Suzanne and four sons.
Learn the tips, tricks, and techniques that allowed large sites such as My Yahoo! and the Yahoo! homepage to continue to grow, scale, and change over time without throwing away previous work.
About Nicholas Zakas
Nicholas is a strong advocate for development best practices including progressive enhancement, accessibility, performance, scalability, and maintainability. He blogs regularly at http://www.nczonline.net/ and can be found on Twitter via @slicknet.
When I tell people I spent a decade studying computer science at MIT and CMU, most assume that I focused my studies in information retrieval — after all, I’ve spent most of my professional life working on search.
But that’s not how it happened. I learned about information extraction as a summer intern at IBM Research, where I worked on visual query reformulation. I learned how search engines work by building one at Endeca. It was only after I’d hacked my way through the problem for a few years that I started to catch up on the rich scholarly literature of the past few decades.
As a result, I developed a point of view about search without the benefit of academic conventional wisdom. Specifically, I came to see search not so much as a ranking problem as a communication problem.
In this talk, I’ll explain my communication-centric view of search, offering examples, general techniques, and open problems.
About Daniel Tunkelang
Daniel Tunkelang is Head of Query Understanding at LinkedIn, where he previously served as Director of Data Science. Before that, he worked at Google on local search quality. He was the Chief Scientist and part of the founding team of Endeca, a leading vendor of search applications for enterprises that Oracle acquired in 2011 for $1.1B. He has also worked at the IBM T. J. Watson Research Center and AT&T Bell Labs. He currently serves as an advisor for LoopIt, Maana, and Origami Logic.
Daniel pioneered the annual symposium on human-computer information retrieval and wrote the first book on faceted search. He was an undergraduate at MIT, double majoring in math and computer science. He completed a PhD at CMU, developing new algorithms for graph layout. He was born and bred in Brooklyn, and lived in New York City most of his life before moving from Brooklyn Heights to Mountain View in 2010 — where he’s still looking for a good bagels and a great karaoke joint.
We get alerts all of the time in this connected world we live in. As engineers, we build alerts to tell us when things are not going as expected. There’s a wealth of knowledge from many non-internet fields that we can learn from in this topic. I’ll talk about alert design from the perspective of Human Factors, and the cognitive costs of alerts: data overload and underload, numbness, and trust in automation. We’ll talk about a few hints on making progress on designing alerts to be useful, not a pain in the ass.
Beyond Media Queries: An Anatomy of an Adaptive Web Design
Media queries may be responsive design’s secret sauce, but we know there’s a whole lot more that goes into crafting amazing adaptive experiences. By dissecting an example of a mobile-first responsive design, we’ll uncover the principles of adaptive design and highlight some considerations for creating contextually-aware Web experiences. We’ll go over emerging mobile Web best practices and responsive patterns that can assist in our journey toward a future-friendly Web.
About Brad Frost
Brad Frost is a front-end designer located in beautiful Pittsburgh, PA. He is the creator of This Is Responsive, a collection of patterns, resources and news to help people create great responsive web experiences. He also created Mobile Web Best Practices, a resource site that lays out considerations for creating great mobile web experiences. He curates WTF Mobile Web, a site that teaches by example what not to do when working with the mobile web. He is passionate about mobile and is constantly tweeting, writing and speaking about it.
Trust, Security, and Society: Human society runs on trust. We all trust millions of people, organizations, and systems every day — and we do it so easily that we barely notice. But in any system of trust, there is an alternative, parasitic, strategy that involves abusing that trust. Making sure those defectors don’t destroy the cooperative systems they’re abusing is an age-old problem, one that we’ve solved through morals and ethics, laws, and all sort of security technologies. Understanding how these all work — and fail — is essential to understanding the problems we face in today’s increasingly technological and interconnected world.
About Bruce Schneier
Bruce Schneier is an internationally renowned security technologist, called a “security guru” by The Economist. He is the author of 12 books — including his latest best-seller Liars and Outliers: Enabling the Trust Society Needs to Survive — as well as hundreds of articles and essays, and many more academic papers. His influential newsletter “Crypto-Gram,” and his blog “Schneier on Security,” are read by over 250,000 people. He has testified before Congress, is a frequent guest on television and radio, served on several government technical committees, and is regularly quoted in the press. Schneier is the Chief Security Technology Officer of BT.
Design for Continuous Experimentation
The design and product process must adapt to accommodate data. This is a tour through the joys and woes of product development when experimentation and measurement are center stage. It is a case for baking honesty and humility into our methods. This is a reprise of a talk originally given at the Warm Gun 2012 conference in San Francisco.
A team of just 4 people scaled Typekit from an idea to a service delivering fonts to hundreds of thousands of websites. Paul Hammond will talk about the infrastructure that made that growth possible, including the specific technology and services used. More importantly he’ll discuss why these choices worked (or didn’t) and give you a framework for technical decisions at your startup.
About Daniel Rabinovich
Daniel Rabinovich is CTO and SVP Product at MercadoLibre, the largest e-commerce platform in Latin America and one of the top ten in the world. Using concrete examples, Daniel shares some of the key lessons learned in the last 10 years. Main topics include solving hard UX problems, the evolution from a closed/monolithic application into an open/decoupled one, how MercadoLibre combines native mobile apps with HTML5, and a successful Facebook integration.
Many of us who work in technology remember reading Hackers for the first time. For many of us, it is part of why we’re in technology. Levy’s 30 years of perspective, insights, and access shape our understanding of the industry we work in, its players, its ethics, and ideas. Steven Levy is a senior writer for Wired, the former chief technology correspondent for Newsweek and the author of seven books.
Kathy has long written about the importance of making your users awesome, instead of trying to tell them why your product is awesome. Once you have awesome, passionate users, they tend to feel as much ownership over your product as you do. Kathy Sierra has been applying “brain-friendliness” to everything from software to books since her days as a game developer.
Obviously, you care about the craft of programming. You spend time honing your skills, refactoring your code, learning new techniques, and experimenting with different libraries. But did you know where you sit, who you talk to, and how you report to your manager all affect the way your software is structured? Coda Hale spoke about how organizational structures influence software and the implications for designing scalable, resilient software systems and companies.
For years, we built web apps that far outpaced the capabilities of the browsers they ran in. Just as the browsers were catching up HTML5 came on the scene – video and audio, canvas, SVG, Application Cache, Web Storage, @font-face, ContentEdible, WebSockets, Web Workers, and more. Now the browsers are racing to stay ahead of the wave that’s building as developers adopt these new capabilities. Is your HTML5 app going to ride the wave or be dashed on the rocks leaving users stranded? Learn which HTML5 features to seek out and avoid when it comes to building fast HTML5 web apps.
Typography is what language looks like it. Type is at the heart of reading and writing, books and brands, websites and magazines. Every hang tag, every mailing label, every web banner, uses typography to convey emotions and information. Ellen Lupton discussed the basic architecture of typography, showing examples both beautiful and appalling of letterforms at work. Her talk was a handy refresher course for designers and a helpful introduction for people new to the indispensable art of arranging letters in time and space
As designers and developers we all want to put our personal stamp on the web and solve problems in uniquely awesome ways. This mentality works fine for small jobs but tends to fall apart with big projects and team environments. Jason will explains how MailChimp’s pattern library helps their team prototype faster, promote collaboration and prevent code bloat.
A look at the state of PHP in 2012. Where are we, how did we get here and how does PHP fit into the current infrastructure ecosystem of the Web? Plus, a quick tour of what is new and cool in PHP 5.4. Rasmus Lerdorf is known for having gotten the PHP project off the ground in 1995 and has contributed to a number of other open source projects over the years. He was an infrastructure architect at Yahoo! for more than 7 years and most recently has been advising startups including WePay, Etsy, and Room77. He was born in Greenland, grew up in Denmark and Canada and has a Systems Design engineering degree from the University of Waterloo. Follow @rasmus on Twitter.
Sebastian Bergmann discussed the ins and outs of PHPUnit. PHPUnit is the test harness of choice for PHP developers all over the world. It has all the features you’d expect in an XUnit framework, plus awesome extras like tools for mocking database connections, and baked-in Selenium integration. At Etsy, we’re proud to be part of the PHPUnit community.
On the web, we operate complex systems. Which means when they fail, it’s not always apparent why or what can be done to learn from failure. Hear from Etsy’s SVP of Technical Operatoins about postmortem analysis, human error, and what it means to build resilience into your systems and organization.
October 18, 2011: Kevin Cheng, Alex Rainert and Charles Adler - Secrets from the World of Product Design
Who does product design? Product Managers, Product Designers and Interaction Designers all come together to do one thing: create great products that people love to use. Panelists Kevin Cheng (previously of Twitter), Alex Rainert (of foursquare) and Charles Adler (of Kickstarter) join Etsy Director of Product to talk about product design.
Brian Moon has been working with the LAMP platform since before it was called LAMP. He is web engineer for dealnews.com. He has made a few small contributions to the PHP project and been a casual participant in discussions on the PHP internals list. He is the founder and lead developer of the Phorum project, the first PHP/MySQL message board ever created. http://brian.moonspot.net/
Marty Abbott and Mike Fisher are the authors of Scalability Rules and The Art of Scalability. They are founding partners of AKF Partners, where they advise companies on scaling technology platforms, organizations, leadership, and processes. Previously, Marty was COO of the advertising technology startup Quigo, where he was responsible for product strategy and management, technology, and client services. Marty also spent nearly six years at eBay, most recently as SVP of Technology and CTO. Mike spent two years as CTO of Quigo, serving as President during the transition following its acquisition by AOL. Prior to that, Mike led a development organization of more than 200 engineers as PayPal’s VP of Engineering and Architecture.
Michael Lopp is a veteran engineering manager who has worked at a variety of innovative companies including Apple Computer, Netscape Communications, Symantec Corporation, Borland International, and a startup that slowly faded into nothingness. Michael writes a popular technology and management weblog under the nom de plume “Rands”, where he discusses his management ideas, worries about staying relevant, and wishes he had time to see more of the world. His weblog can be found at http://www.randsinrepose.com.
Ryan is a Product Manager and Lead UI Designer. Since 2003, his interface and software designs for 37signals have pushed the standards of web application usability and clarity. Ryan is an internationally recognized speaker on interface design and web software production. He lives in Chicago with his wife and two french bulldogs.
Fred Brooks, author of The Mythical Man-Month, will be at the Etsy offices on Monday, June 14th 2010 as part of the Etsy Speaker Series at 6pm EDT. In addition to The Mythical Man-Month, Brooks is also known for the paper No Silver Bullet: Essence and Accidents of Software Engineering and for founding the Department of Computer Science at the University of North Carolina at Chapel Hill. His latest book, The Design of Design, was released last month.