Joshua D. Drake Blog Posts




The presentation includes an introduction and setup for consul as the means of providing highly available PostgreSQL in local and geographically disparate data centers or cloud providers. The presentations includes:

*) Introduction to consul and its architecture
*) Setup of a single consul cluster
*) Setup for a few sample database instances (OLAP and OLTP)
*) Firewall requirements
*) Integration with bind, djbdns, and dnsmasq
*) Setup geographic failover to two different data centers and cloud providers
*) Various Best Practices tips and suggestions
*) Q&A

Joshua D. Drake     April 25, 2017

Adaptation Lizard

As Postgres Conference pushes forward in the brave new world, we evolve and increase the ability for the People, Postgres, Data community to succeed. As a part of our positive adaptation we have a new website that features upcoming events, professional content (written and video), and the best in our written community via “Community Content”.

Discord

In an effort to provide a modern, friendly, and inclusive community platform, we have launched a Discord server for all things Postgres. We are providing a helpful experience with rule #1 being: Be Nice. Our discussions will branch out beyond the core of PostgreSQL and provide a forum for success with Postgres and related technologies. Join us for what is guaranteed to be a refreshing experience for the community: https://discord.gg/tjxNBCz

2021

We are seeking feedback from our community on 2021 in-person events. We are currently considering the East Coast event for October 2021 and the West Coast event for December 2021. Please help us in determining the type of event you would like to participate in!

Upcoming live events

We currently have the following webinars scheduled through October:

Joshua D. Drake     August 25, 2020

Tell us about your commitment and contribution to the Postgres Community

For over 10 years, EnterpriseDB (EDB) has been working with the community and enterprises to drive Postgres forward. EDB is one of the top PostgreSQL community contributors. Two of our team members are part of Postgres Core team, while 4 are committers, and 6 are named contributors. We invest heavily into Postgres performance, scalability, availability, migration, integration and support to make sure that enterprises can take advantage of Postgres' rapid innovation cycle and advanced capabilities.

 

What growth pattern do you expect for yourself as well as Postgres as a whole?

Postgres adoption is exploding and we can see that in our business results. Today, we support 92 of the Fortune 500 and 311 of the Forbes Global 2000. Our customers look to us for a reliable, high-performing, and cost-effective data management platform based on open source PostgreSQL.

 

Our customers are using EDB Postgres for mission critical applications. Their databases range all the way up to 50 TB with some handling over 50K transaction per second in environments that require 99.99%+ availability.

 

Our customers’ confidence in Postgres and EDB is no surprise. Postgres has been the #1 open source relational database in the DB-Engines.com rankings for two years in a row and EnterpriseDB has been chosen for the Gartner Magic Quadrant for Operational Database Management Systems for six years in a row.

 

 

How do you plan to assist Postgres in the future?

EDB continues to invest heavily in Postgres with key projects such as zHeap, Just-in-Time (JIT) compilation, and other efforts focused on performance and scalability.

 

What is the number one benefit you see within Postgres that everyone should be aware of?

EDB Postgres has become the general purpose database of choice for digital transformations, offering JSONB document support, GIS-support, EDB Postgres Oracle® compatibility features, key-value pair data, and increasing capabilities for analytical workloads. It has the fastest innovation cycle, the best deployment models, and the lowest cost of any commercial relational database.

 

What is the best thing about working with the Postgres community?

The best thing about working with the Postgres community is their fast innovation, resulting in extremely reliable code.

 

Tell us why you believe people should attend PostgresConf 2019 in March.

PostgreSQL is one of the oldest and most stable open source projects as a result of the commitment of its members and its independence as a stand-alone community. Over the years, Postgres has achieved parity with proprietary platforms in terms of performance and functionality. It has received a warm welcome from businesses looking to roll back database costs and ease vendor lock-in, and leading companies are adopting it with great success. This is just like it was with Linux 15 years ago. Enterprises understand that they have to adopt Postgres or they will be left behind.

 

Company Description
EnterpriseDB (EDB), the database platform company for digital business, delivers the premier open source-based data platform for new applications, cloud re-platforming, application modernization, and legacy migration. EDB Is the developer of the most complete Postgres-based database platform.

 

Joshua D. Drake     February 12, 2019

 
 

As part of the countdown to PostgresConf US 2018, learn more about the engaging content and our Diamond and Platinum sponsors for this year in our Sponsor Spotlight Series.

Jacque Istok, is the Head of Data for Pivotal, one of our Diamond Sponsors for PostgresConf US 2018. Pivotal is hosting the first annual Greenplum Summit at PostgresConf US 2018, with lots of great Greenplum and Postgres-related content. Read what Jacque has to say bout Greenplum and Postgres, as well as why to attend the Greenplum Summit: 

Greenplum is an Open Source variant of Postgres; what benefits do you bring to the table over vanilla Postgres?

Postgres is a powerful ORDBMS, but as your data scales, the only way to keep up is to buy bigger and bigger machines to run on. It suffers from the same problems that all SMP databases do: you can only get as big as the machine you’re running on.

With Greenplum you can put a subset of your data on a Postgres database on one reasonably-sized machine, and another subset on a second machine, and so on. All of your users and applications can then query one of these Postgres databases as if all the data was in a single location - making your data scale limitless. Greenplum manages the distribution, data shuffling, and querying of all of your data across a magically sharded implementation of Postgres databases.

Greenplum has its own community; what do you hope to achieve by joining the Postgres community and PostgresConf?

The Postgres community represents some of the most passionate and knowledgeable creators, developers, and users of database technology of our time. We believe that the combination of Postgres and Greenplum becomes the software equivalent of what Oracle Exadata purported to be: an all-purpose database that can do both transactional and analytical workloads across multi-structured data. Simply put, the Greenplum community is looking to join with the Postgres community to further the understanding and adoption of these technologies.

Do you have plans for cross pollination of technologies with the two open source projects?

Greenplum forked from Postgres over 10 years, circa Postgres 8.2. Greenplum 5.0 is based off of Postgres 8.3, with our next major release slated for Postgres 9.4 (current open source Greenplum is compatible with 9.0 as of this writing).

Likewise, we have Postgres committers working at Pivotal looking for opportunities to improve the Postgres code specifically for analytics. We are also ensuring that other projects related to Greenplum, like Apache MADLib, continue to be compatible with Postgres.

What challenges do you see working with the Postgres community as an open source fork?

The Postgres community is a long-running and very passionate group, and we want to be both collaborative and respectful in how we continue to grow our participation. We see the products as having synergies which complement each other very well, with some use cases that best fit Postgres, and others that best fit Greenplum. The use of either benefits the other as they both further adoption.

What would you tell a user who has a choice between Postgres and Greenplum about when they should use which system?

Postgres is a great ORDBMS that will scale to the performance of a single server. For analytical needs, being restricted to a small number of terabytes does not allow for the type of exploration that most organizations need. Because Greenplum is a Postgres compatible database, you can start out using Postgres and either convert to Greenplum underneath or leverage Greenplum alongside your Postgres systems (making data ETL a ton easier). This then makes the choice of which product to use for your particular use case clearer and clearer.

What is the number one barrier you see to contributing to the Postgres community?

The number one barrier we will have to contributing is not seeing the corresponding adoption of our technologies. We feel very strongly that both the transparency and removal of vendor lock-in make our open source commitment the only choice for users. I’m here to implore the community to embrace our technology with zeal and help us continue to drive more and more Postgres adoption in the world.

What is the best thing about working with the Postgres community?

Because Greenplum is based on Postgres, we get to interact with this vast community of talent. We are also able to more seamlessly interact with ecosystem products that already work with Postgres, making the adoption of Greenplum that much easier.

Tell us why you believe people should attend PostgresConf 2018 in April.

PostgresConf is going to be awesome - with both Pivotal and Amazon headlining as Diamond sponsors - as well as the quality of speakers and their content. I wouldn’t miss it for anything.

We’re thrilled to organize the first annual Greenplum Summit at PostgresConf. Greenplum co-founder, Scott Yara, will give a keynote on April 18th relating to how data tells the story at the organizations that we help enable (#DataTellsTheStory), and his journey from SMP to MPP. Greenplum Summit on April 19th will be a full day packed with with great use case sessions and tech talks for novices and experts alike.

Check out the full schedule for PostgresConf US 2018, and buy your tickets soon!



Joshua D. Drake     March 26, 2018     pivotal Greenplum postgres postgresql

You will want to mark your calendars folks on August 15th the Call for papers for PostgresConf Silicon Valley will close. That is just two weeks away!

So let's point your Firefox, Google Chrome, or Safari app to this link right here and get your presentation submitted.

This is the inaugural Silicon Valley conference and from the current submitted papers it is shaping up to be a fantastic event. We can't wait to see everyone and continue our mission of:




Joshua D. Drake     July 31, 2018
Audience 945449 1920

 

Like most conference organizers we are learning to adapt to the new world; a world where physical events are no longer viable (at least in 2020). A world where people are genuinely and realistically concerned that an in-person event would increase their chances of receiving or spreading a life threatening virus.

 

The question is: Are in-person events a thing of the past?

 

The answer to that question is a difficult one. Our friends at O'reilly and Associates have permanently canceled their in person events. Our friends in Europe recently canceled the well respected PgConf.EU and Ibiza. We had to cancel our 2020 marque event in NYC in March and our upcoming Silicon Valley conference. The local community organizer website Meetup.com has even modified their capabilities to allow for online meetups. 

 

Humans in general seek out fellow human contact. That contact is usually of reasonably like minded individuals or at least mutual interests. This is why events like Postgres Conference are successful, because irrespective of any personal beliefs we are all there to learn and enjoy fellow Postgres professionals. But are virtual meetups and conferences going to be enough to satisfy that connection or are people going to demand a return to a historical norm?

 

Challenges

Even before COVID-19, in-person events came with challenges that put significant pressure on volunteers. Between cultural communication differences, having an independent Code of Conduct committee, pricing, economies of scale, partner demands, and now social distancing, conferences are now going to be more complicated than ever. A room that once could comfortably seat 100 can now only properly sit 30. An exhibit hall is likely out of the question and one-on-one mentoring and networking are likely not going to be viable.  How do we work around these limitations? Is it worth it? Are the people in our community even interested anymore or is it time to accept a new norm?

Opportunity

Without question this is a time of reflection, continued development of relationships, and looking into the magic 8-ball; a continual asking of questions to find the right path forward. The pandemic is a tough foe but true leaders are looking forward and trying to find ways to continue to serve. For that to be successful we need your help. We have put together a poll (that can be found here) to gain insight into what opportunities we may be able to pursue in the future. Please take a couple minutes and help shape the future of Open Source events. 

 

As a closing, we are actively moving forward with Digital Events across the globe and have an unending Call for Presentations open for Webinars. If you have any feedback or brilliant ideas, please send them to us via organizers@postgresconf.org.

 

Blatant Poll Link 

Joshua D. Drake     July 17, 2020

 

It is late August, 2019. This is the time where we are usually prepping for the very busy fall season and not much else. However, this is the Year of Postgres and everyone is driving 200MPH down the ecosystem highway (321.8688/KPH). We are going to kick off this newsletter with some exciting information about the community.

Events

PostgresConf has launched Digital Events! The goal of Digital Events is to open our education platform year round to all members of the community. Our first series of events will be held with our ecosystem partner YugabyteDB and their “Distributed SQL Webinar Series.” This is a series of free-to-attend Webinars exploring Distributed SQL from leaders in the field.

 

PostgreConf Silicon Valley tickets are going at a brisk pace and half day trainings are almost sold out. Register today to reserve your seat before prices go up on September 1st!

 

Right after Silicon Valley, PostgresConf South Africa is kicking off. This conference has grown by leaps and bounds over the last two years. We highly recommend attending for anyone who can!

 

PGConf.IN (India) has announced that their conference will be held in February 2020!

Meetups

We have seen the launch of three new meetups this month:

  • Los Angeles Postgres The first meetup is planned for late October or early November as we continue to build the Silicon Beach community.
  • Toronto Postgres Similar to Los Angeles, the first meetup is planned for late October or early November.
  • Charm City Postgres This meetup was formed by long time community member Robert Treat.

 

Several other meetups are growing quickly: 

 

Interested in speaking or hosting a meetup? Contact us and we’ll connect you with the right people! 

Learn

Here is a short, great introduction tutorial on running PostgreSQL in Docker by Igal Sapir, Los Angeles Postgres organizer. Everybody has 13 minutes.

 

Shawn Wang from our friends at High Go has provided an insightful write-up on AES Performance.

Ecosystem

TimescaleDB is running a “State of Postgres” survey. Please take five minutes and help them out! They have also announced a new Distributed Timeseries product.

 

VMWare has just acquired Greenplum and PostgreSQL supporting company Pivotal.

Postgresql.org

PostgreSQL versions 11.5, 10.10, 9.6.15, 9.5.19, 9.4.24, and 12 Beta 3 are now out in the wild and addressing several important security concerns and bug fixes.

 

---

 

Have news you’d like included in future newsletters? Contact us.

Joshua D. Drake     August 23, 2019

Brass tacks

  • Silicon Valley is selling tickets briskly, get yours today and join us at the largest gathering of Postgres leaders on the West Coast.

  • South Africa is set to release their schedule shortly. Watch the site for opportunities in October.

  • We have hinted at digital events in the past and they are in the final planning stages. Digital events will encompass best in class content from our community in the format of Webinars, Q&A sessions and Professional electronic training opportunities. Watch for more news on these unique opportunities as we get closer to Fall 2019.

Seasons

It is the middle of summer, and as Glenn Frey would say, “The Heat is on!” Summer is the time when everyone is busy, yet nobody is busy. You have a contract to execute but the signer is on vacation. You have a project to complete but your digital nomad developer took off for the beach. Suddenly even checks may be delayed because of a long weekend up in the mountains. It is also a time to catch up on the things that may have been overlooked. When the person driving your priorities is on vacation it is easier to step back and observe your purpose.

 

Introduction

At PostgresConf 2019 in Manhattan we organized a Diversity and Inclusion panel with the help of Plato. The panel was well attended, but not as much as we had hoped. This fact outlined that we had more work to do on expanding our leadership position within Diversity, Equity and Inclusion in the Professional Postgres community.

We take this topic very seriously and we would consider PostgresConf and our focus on People, Postgres, Data a success if the only outcome was for all to feel welcome and supported within our community. Thankfully we have organizers and volunteers who are passionate about this very topic.

We would like to introduce the PostgresConf and PgCentral Foundation DEI (Diversity, Equity and Inclusion) Work Group:

  • Debra Cerda: DEI Organizer

  • Henrietta Dombrovskaya: Contributor

  • Ryan Lambert: Contributor

  • Mara Lemagie: Contributor

  • Vikki McCormick: Contributor

  • Amanda Nystrom: Co-Chair Sponsor

Over the coming months we will be continuing to communicate our passion, our purpose, our action and our accomplishments in bringing true Diversity, Equity and Inclusion to our community.

“A genuine leader is not a searcher for consensus but a molder of consensus” -- Martin Luther King

 

PostgresConf Philly which is organized in conjunction with Philly Postgres sold out in July! A packed room, great content and glorious collaboration was available to all for free due to the generous support of the Wharton School for Business!

As we continue to build our professional relationships, connections with academia are going to be vital. Academia is one of the few spaces that Postgres has not been able to make assertive gains in adoption and it crucial to the long term vision of our community that Academia recognize and adopt Postgres as the World’s Database and a viable option for teaching the next generation of data experts.

 

International communication

As our community grows Internationally with strong ties to Asia, and countries in the Southern Hemisphere it becomes difficult to connect with those cultures using our normal nomenclature. In our last newsletter we used a quote meant to be a compliment and challenge to the Western communities to try new things. The quote was about pigs ears and how they are delicious. The quote was interpreted by some in the Asia community as negative.

While writing this newsletter, we had used a spelling variation for the term “Wowzers” which in American pop culture is meant to be an exclamation of amazement. However in other cultures it maintains a negative connotation causing us to change the term to Kapow. These communication challenges show us that we must be open and without pride in our communication. We must show patience and understanding with cultures that are not like ours and that the communities that are able to achieve this will lead the future of Open Source and Postgres.

“Every human is like all other humans, some other humans, and no other human” — Clyde Kluckhon

Joshua D. Drake     July 31, 2019

PostgresConf Beijing 2019

Join our Mailing List | Attend one of our events |

Last week was PostgresConf Beijing 2019. This event was an exercise in people understanding what it truly takes to run a conference. It was a standalone event unlike PostgresOpen China in 2018 which always takes a lot more work. We had generous sponsor support with the likes of Microsoft, Amazon Web Services, IBM, Pivotal, Inspur, HighGo, Credativ, and Command Prompt.

The overarching theme of the conference was of course People, Postgres, Data and we had many (translated) conversations about how Postgres can be the center of your Data Universe and how the ecosystem thrives with not only PostgreSQL but also technology such as TimescaleDB and Yugabyte. All of which are Open Source and enable People to use Postgres to manage their Data. In 2020, the plan is to have PostgresConf China in October or November. The timing will allow for a more moderate climate as well as have more time to generate international content.

English As A Second Language

As we continue to work with English-as-a-second-language communities we continue to find opportunities for them to grow and contribute. Of course the most common (and possibly difficult) opportunity is that in order to contribute code to PostgreSQL.Org, you must speak English. This is not an unreasonable requirement as English is the language of Computer Science.

A common piece of feedback we received was not that English was the consideration but the “level” of English proficiency was high. Unfortunately, verbosity is not always productive and it is certainly counterproductive when the vocabulary doesn’t take into account the non-native speaker. It would be a boost to productivity if we as a community tried to be succinct and as uncomplicated as reasonable in our communication. To put this another way and from a far more qualified source than us:

“Don't use a five-dollar word when a fifty-cent word will do.”

-- Mark Twain

Contribution Opportunities

While encouraging the Chinese community to contribute we continued to look for the low barrier of entry tasks. The obvious opportunity is translation of various project documentation. That is not the only prospect as PostgreSQL has fantastic extensibility and suggestions of developing new extensions. Contributing directly to PostgreSQL code has a high barrier of entry between English as a second language and overall overhead in building comprehensive knowledge of the core code. Extensions in contrast generally require needing to understand narrow areas of code to build a feature that is user-need specific. We are still exploring these opportunities but one option would be to invite extension authors to work with regional communities for translation or feature work.

Software You Weren’t Aware Of

Oleg from PostgresPro and PGConf.Russia was present and we were able to have some great conversations about the work they are doing, most of which can be found on Github. Although there is a lot of great software in that repository, the one that grabbed my eye as immediately useful was Zson. Zson is an extension that allows native compression of JSON/JSONB documents, greatly reducing disk space usage and increasing query speed of documents.

Please Replace IRC and Slack

Further conversations were had on how we can build a modern collaboration community that is internationally inviting, supports all languages, and is built on Open Source technologies. Initially it seems that Mattermost is a good contender but after further research it seems that we should also consider Matrix.org. The idea has barriers as the Chinese are partial to WeChat and the Professional U.S. community has left IRC for Slack, whereas other communities such as Brazil and Russia have settled on Telegram. We have a community member based working group determining next steps.

You may say that I'm a dreamer

But I'm not the only one

I hope someday you'll join us

And the world will be as one

-- John Lennon

Looking Forward

As People, Postgres, Data and PostgresConf continues to move forward we are looking forward to building on existing initiatives and events. We have PostgresConf Philly next week, PostgresConf Silicon Valley in September, and our next International event in October with PostgresConf South Africa. We are also continuing to work on our Inclusivity, Equit,y and Diversity initiative and launching Digital Events! This doesn’t include the growing number of meetups joining the idea of People, Postgres, Data including NYC Postgres, Silicon Valley Postgres, Philly Postgres, Seattle Postgres, and Montreal Postgres!

Quote of the week

“Those pig ears are really good.” -- Michael Meskes, Credativ and Postgresql.org committer.

Joshua D. Drake     July 11, 2019     #postgres #postgresconf

Announcing PostgresConf Silicon Valley 2019, September 18th - 20th at the Hilton San Jose! An absolute perfect pairing of training, breakout sessions, and a fantastic weekend break to enjoy the valley for every speaker, attendee, volunteer, and organizer. 

Didn't you just host the community at PostgresConf Silicon Valley, you ask? Why yes we did! That event was October 15th and 16th of 2018. The event was such an unexpected success that we immediately started working with the hotel to lock in our dates for 2019. We requested mid-October to early November. Unfortunately, the only week they had available was the week of September 15th, 2019. We are again working with the Silicon Valley Postgres Meetup; the fastest growing Postgres meetup in the United States. 

As we continue to be the fastest growing, non-profit, inclusive, and volunteer organized event we are providing you the breakdown of the Silicon Valley 2018 financials:


PostgresConf Silicon Valley is much more cost effective than the "big" conference in Manhattan and that is exactly what we want as a development or "local" conference. We are targeting 50% growth for 2019 and we want do so in a way that is inviting to new community members that won't overwhelm them. We succeeded with that in 2018 and we are going to continue the mission of People, Postgres, Data!

The global non-profit Postgres Conference Series


Joshua D. Drake     November 14, 2018