Joshua D. Drake Blog Posts

Where is your path leading you?

 

At Postgres Conference Silicon Valley I promised during the launch that after the conference was completed PostgresWarrior and I would be taking a freedom tour to various National Parks. 

 

For us, our path is serving the community through education and professional and personal development. This happens in many forms including these newsletters.

 

Recent projects have been coordinating a successful webinar series from Yugabyte, creating  online live Postgres instructor lead training, and launching a new educational series on PostGIS. This is all happening while the Call for Papers for Postgres Conference 2020 now open! The ongoing goal is to allow any person to receive the education they need to be successful with People, Postgres, Data year around.

Training

The current training options from Postgres Conference can be found here:

https://postgresconf.org/conferences/Postgres-Digital-Training-Series/schedule/events

We have two performance trainings coming up in October:

  • PostgreSQL Performance & Maintenance on October 29th
  • Finding and Fixing Slow Queries on October 30th

 

Both of these training opportunities sell out at the physical conferences. They are solid content and at a reasonable price (149.00 USD ) it is hard to say no to a few hours for education in your day!

Software

Are you frustrated with the limitations and fragility of Logical Replication in PostgreSQL Core? There is a new software on the block called pgcat and it has an impressive list of features to allow your Logical Replication experience to be exceptional.

 

Looking for a simple script to help find tuning opportunities for PostgreSQL? The perl script postgresqltuner may just be what you are looking for. Yes, there really is an active developer community for the Perl language still.

 

A HyperLogLog data type for PostgreSQL from our friends at Citus. This Postgres module introduces a new data type hll which is a HyperLogLog data structure. HyperLogLog is a fixed-size, set-like structure used for distinct value counting with tunable precision. For example, in 1280 bytes hll can estimate the count of tens of billions of distinct values with only a few percent error.

 

Our partner Heimdall Data has been creating a new type of connection pool that removes a significant limitation within other software such as PgBouncer and PgPool. If you are looking for Enterprise Authentication (Active Directory/LDAP) as well as intelligent pooling for many users (and connections), it may be worth a look. There is a webinar next week on how it all works!

Does your path allow people to “Come as you are?”

In consideration of all of the great news from our community we can’t help but reflect on the blessings we have in the world of Open Source. Remember that Open Source is about exceptionalism, creativity, and most importantly freedom. When communities start restricting these three tenets of Open Source, they are no longer Open Source communities, even if their software is.

 

The theme for Postgres Conference 2020 in NYC is “come as you are” and we are asserting this mantra throughout our entire community. Over the past few years there has been an influx of toxicity throughout all circles and it is time for civility and grace to return. It is time to remember that we are all human. We all have angels and demons to our personalities. We are all flawed and we are all exceptional in our own way.

 

"But just because I don't agree with someone on everything doesn't mean that I'm not going to be friends with them. When I say, 'be kind to one another,' I don't only mean the people that think the same way that you do. I mean be kind to everyone."

 

-- Ellen DeGeneres

 

(Yes, this happened. No, it wasn’t planned.) 

Just outside of Moab Utah.

 

Find YOUR path.



Joshua D. Drake     October 17, 2019


How do you use Postgres?

I work Fred Hutchinson Cancer Research Center and within Fred Hutch, I work for the largest group called SCHARP, Statistical Center for HIV/AIDS Research and Prevention. We use Postgres to monitor the AIDS drug trials real time to see if the trials are working or not. This means we collect the data from doctors and labs around the world, and analyzing the data. We also have servers where we receive data from other research institutes and share our randomized data, de-personalized, with other research institutes.


What community contributions have you provided?

In 2010 I started SeaPUG, Seattle Postgres Users Group, at the request of Josh Drake. I have at least have the presentations there every year. I have also discovered several PostgreSQL: bugs which have been fixed. Some of them affected every version of PostgreSQL. Bug numbers: 7553, 8173, 8257, 8291. I also found 8545, which has not been fixed but Core has acknowledge needs to be fixed but they are not sure where it should be fixed, pg_dump or pg_dumpall. I started the PostgreSQL track at LinuxFest Northwest in 2014 after my GIS presentation in 2013 was standing room only. This year I got a booth at the SeaGL, Seattle GNU Linux, conference with the idea of having a booth there next year along with also doing a PostgreSQL presentation next year at the conference.


You recently took a renewed interest in speaking at Postgres Conferences, why?

I have been giving presentations locally now for the last 7 years and so I am now ready to move on to the next step, doing presentations at the Local and National conferences around the United States.


What is the #1 barrier you see to Postgres adoption?

People not knowing about PostgreSQL, most people know about MYSQL, MSSQL and Oracle, but do not know about PostgreSQL. This is changing, some, with the Cloud providers now offering PostgreSQL, but I go to these conferences, LinuxFest Northwest and SeaGL, and people all the time are asking me, "What is Postgres and why should I use it over MYSQL, MSSQL or Oracle", because they have never heard of PostgreSQL.


What is something you feel the wider Postgres community could be better at?

We need to promote PostgreSQL so that new people starting personal projects and starting at companies, will think about PostgreSQL before other databases. This starts with getting the younger generation interested in PostgreSQL and that also means that we need to get the college professors willing to talk about PostgreSQL in their curriculums instead of ignoring PostgreSQL for all the other competing databases. Some of this means that at all the other conferences, we need to have a PostgreSQL presence, aka booth and presentations. We should also come up with a certification method for PostgreSQL DBA's, User's, Engineer's, etc so that prospective employers will have an idea of the prospective employees skill set.

Joshua D. Drake     December 12, 2017




The presentation includes an introduction and setup for consul as the means of providing highly available PostgreSQL in local and geographically disparate data centers or cloud providers. The presentations includes:

*) Introduction to consul and its architecture
*) Setup of a single consul cluster
*) Setup for a few sample database instances (OLAP and OLTP)
*) Firewall requirements
*) Integration with bind, djbdns, and dnsmasq
*) Setup geographic failover to two different data centers and cloud providers
*) Various Best Practices tips and suggestions
*) Q&A

Joshua D. Drake     April 25, 2017

PostgresConf Beijing 2019

Join our Mailing List | Attend one of our events |

Last week was PostgresConf Beijing 2019. This event was an exercise in people understanding what it truly takes to run a conference. It was a standalone event unlike PostgresOpen China in 2018 which always takes a lot more work. We had generous sponsor support with the likes of Microsoft, Amazon Web Services, IBM, Pivotal, Inspur, HighGo, Credativ, and Command Prompt.

The overarching theme of the conference was of course People, Postgres, Data and we had many (translated) conversations about how Postgres can be the center of your Data Universe and how the ecosystem thrives with not only PostgreSQL but also technology such as TimescaleDB and Yugabyte. All of which are Open Source and enable People to use Postgres to manage their Data. In 2020, the plan is to have PostgresConf China in October or November. The timing will allow for a more moderate climate as well as have more time to generate international content.

English As A Second Language

As we continue to work with English-as-a-second-language communities we continue to find opportunities for them to grow and contribute. Of course the most common (and possibly difficult) opportunity is that in order to contribute code to PostgreSQL.Org, you must speak English. This is not an unreasonable requirement as English is the language of Computer Science.

A common piece of feedback we received was not that English was the consideration but the “level” of English proficiency was high. Unfortunately, verbosity is not always productive and it is certainly counterproductive when the vocabulary doesn’t take into account the non-native speaker. It would be a boost to productivity if we as a community tried to be succinct and as uncomplicated as reasonable in our communication. To put this another way and from a far more qualified source than us:

“Don't use a five-dollar word when a fifty-cent word will do.”

-- Mark Twain

Contribution Opportunities

While encouraging the Chinese community to contribute we continued to look for the low barrier of entry tasks. The obvious opportunity is translation of various project documentation. That is not the only prospect as PostgreSQL has fantastic extensibility and suggestions of developing new extensions. Contributing directly to PostgreSQL code has a high barrier of entry between English as a second language and overall overhead in building comprehensive knowledge of the core code. Extensions in contrast generally require needing to understand narrow areas of code to build a feature that is user-need specific. We are still exploring these opportunities but one option would be to invite extension authors to work with regional communities for translation or feature work.

Software You Weren’t Aware Of

Oleg from PostgresPro and PGConf.Russia was present and we were able to have some great conversations about the work they are doing, most of which can be found on Github. Although there is a lot of great software in that repository, the one that grabbed my eye as immediately useful was Zson. Zson is an extension that allows native compression of JSON/JSONB documents, greatly reducing disk space usage and increasing query speed of documents.

Please Replace IRC and Slack

Further conversations were had on how we can build a modern collaboration community that is internationally inviting, supports all languages, and is built on Open Source technologies. Initially it seems that Mattermost is a good contender but after further research it seems that we should also consider Matrix.org. The idea has barriers as the Chinese are partial to WeChat and the Professional U.S. community has left IRC for Slack, whereas other communities such as Brazil and Russia have settled on Telegram. We have a community member based working group determining next steps.

You may say that I'm a dreamer

But I'm not the only one

I hope someday you'll join us

And the world will be as one

-- John Lennon

Looking Forward

As People, Postgres, Data and PostgresConf continues to move forward we are looking forward to building on existing initiatives and events. We have PostgresConf Philly next week, PostgresConf Silicon Valley in September, and our next International event in October with PostgresConf South Africa. We are also continuing to work on our Inclusivity, Equit,y and Diversity initiative and launching Digital Events! This doesn’t include the growing number of meetups joining the idea of People, Postgres, Data including NYC Postgres, Silicon Valley Postgres, Philly Postgres, Seattle Postgres, and Montreal Postgres!

Quote of the week

“Those pig ears are really good.” -- Michael Meskes, Credativ and Postgresql.org committer.

Joshua D. Drake     July 11, 2019     #postgres #postgresconf

Announcing PostgresConf Silicon Valley 2019, September 18th - 20th at the Hilton San Jose! An absolute perfect pairing of training, breakout sessions, and a fantastic weekend break to enjoy the valley for every speaker, attendee, volunteer, and organizer. 

Didn't you just host the community at PostgresConf Silicon Valley, you ask? Why yes we did! That event was October 15th and 16th of 2018. The event was such an unexpected success that we immediately started working with the hotel to lock in our dates for 2019. We requested mid-October to early November. Unfortunately, the only week they had available was the week of September 15th, 2019. We are again working with the Silicon Valley Postgres Meetup; the fastest growing Postgres meetup in the United States. 

As we continue to be the fastest growing, non-profit, inclusive, and volunteer organized event we are providing you the breakdown of the Silicon Valley 2018 financials:


PostgresConf Silicon Valley is much more cost effective than the "big" conference in Manhattan and that is exactly what we want as a development or "local" conference. We are targeting 50% growth for 2019 and we want do so in a way that is inviting to new community members that won't overwhelm them. We succeeded with that in 2018 and we are going to continue the mission of People, Postgres, Data!

The global non-profit Postgres Conference Series


Joshua D. Drake     November 14, 2018

Due to a rise in concern around the Omnicron variant of COVID-19 and surprise remodeling/construction from the Hilton, Postgres Conference Silicon Valley 2022 has been rescheduled. The hotel has been apologetic and accommodating. The new dates for the conference are:

April 7-8 (Thursday - Friday)

Though this was an unexpected decision, we are confident that the delay of the event will result in a positive outcome for all involved.

Thank you for your support!

Get your tickets here.

Joshua D. Drake     January 05, 2022

 

At Postgres Conference we are always optimizing our People, Postgres, Data experience, and as more events move to Digital,  we have worked hard to perfect that collaborative experience for our community. The hard work of our volunteers has paid off, our content is top notch, and our participant account is consistently high.

 

With a now-proven track record, we are pleased to announce that we are accepting Community and Commercial presentations via the Postgres Webinar Series Call for Presentations through the end of 2020. If your presentation is accepted we will contact you directly to arrange an appropriate time to deliver your content.

Recent awesome news

KDE, arguably the most complete desktop experience for Linux, is now hosted on a private instance of Gitlab. As is proper, Gitlab only supports Postgres as the backend database.

For those who who love #FarmFresh or #farmtotable, there is a new website that showcases Farms that are delivering. It was developed using React, Rails, and Postgres. 

Upcoming Digital Events

  • July 7, 10am PT: Deep Dive into PostgreSQL Indexing

A Deep Dive into PostgreSQL Indexing

  • July 15, 10AM PT: Working with JSON Data in PostgreSQL vs. MongoDB

Working with JSON Data in PostgreSQL vs. MongoDB

Previous Digital Events:

The International Postgres conference  series continues to grow! PGConf APAC 2018 is the latest PGConf.Org addition.

Following the success of two consecutive pan-Asia Postgres event - pgDay Asia 2016 and pgDay Asia 2017 held along with FOSSASIA, we are pleased to announce PGConf APAC 2018 to be held in Singapore from 22nd to 24th of March, 2018. Once again the conference will be held along with FOSSASIA - one of the largest FOSS conference on the planet. PGConf APAC will be PostgreSQL conference series for all PostgreSQL enthusiasts and users in the Asia Pacific region.
For more details on FOSSASIA - http://2018.fossasia.org
You will be able to enjoy one of the largest PostgreSQL conference in Asia and one of the largest FOSS conferences to meet like minded individuals in the same week!
pgDay Asia 2016 and pgDay Asia 2017 would not have been possible without your awesome talks and we would like to invite speakers from all over the globe to present at the PGConf APAC 2018. We would like to open Call For Paper for PGConf APAC 2018. Some of the topics which can be used for submitting a talk are-
  1. Migration projects
  2. Performance troubleshooting and tuning
  3. noSQL and geo-spatial features of Postgres
  4. Unique use-case and customer stories
  5. Useful new features in PostgreSQL 10
For more examples you can refer to the papers which were presented at last year's event - 2016 and 2017.
Of course we are happy to accept paper proposals on any other interesting topics as well.
To submit you proposal for presentation please go to this link - http://2018.pgconfapac.org/cfp
Venue
To be Announced
Call for Papers
2017-10-10: Proposals acceptance begins
2017-12-04: Proposals acceptance ends
2017-12-13: Authors of accepted proposals contacted
If you need any additional information please contact our team at pgconfapac(at)googlegroups(dot)com.
This conference is organized by the PostgreSQL people from Asian communities. If you have any question, feel free to contact us on pgconfapac(at)googlegroups(dot)com.
For sponsorship related queries please get in touch with our team at apac-organizer(at)pgconf(dot)org.
Joshua D. Drake     October 10, 2017

 

Image result for seattle hd wallpaper


It is with great pleasure that we announce the final program for PGConf Local: Seattle. The schedule is still being hammered out but we have finalized the content that will be presented. Please join us in celebrating Postgres in Seattle!

 
The conference is the first Postgres event to be held in Seattle since 2009 and we have received a lot of positive feedback from the local Postgres and Data communities. Clearly Postgres has been missed in the Emerald City!
 
Training Options:
Breakout Sessions:

Track: Ops

  • Develop intelligent apps on the Azure platform using the Azure Database for PostgreSQL by Sunil Kamath
  • Tuning PostgreSQL for High Write Workloads by Grant McAlister
  • POSTGRESQL V10: AN AMPLIFIED VERSION OF POSTGRES by Joshua D. Drake
  • Enterprise Data Architecture with PostgreSQL by Kevin Kempter
  • All the dirt on Vacuum by Jim Nasby
  • Building a scalable time-series database on PostgreSQL by Matvey Arye

Track: Dev

  • Semantic Search Web System on PostgreSQL by QUAN-HA LE
  • Increase Application Performance with SQL Auto-Caching; No Code Changes by Roland Lee
  • Introduction to JavaScript Stored Procedures by Jim Mlodgenski
  • Under the hood: API integrations and more in an energy efficiency PostgreSQL + Django application by Jennifer Scheuerell
  • Using GIS in PostgreSQL by Lloyd Albin

Tracks: Big Data, Data Science and AWS/Cloud

  • With Great Power Comes Great Responsibility by Michael Sacks
  • Data Quality Expert Is Not Harvard's Sexiest Job...But... by Ben Rogojan
  • GRAKN.AI: the hyper-relational database for knowledge-oriented systems by Haikal Pribadi
  • Best Practices with Managed PostgreSQL in the Cloud by Jignesh Shah
PGConf Local: Seattle is made possible by the wonderful team of volunteers including the Seattle Postgres User Group and our sponsors:
 
 
Diamond2
 
Platinum: Compose.IO, OpenSCG, 2ndQuadrant, and Microsoft
Joshua D. Drake     October 19, 2017

Silicon Valley Postgres and PostgresConf Silicon Valley are happy to announce that early bird tickets are now available! You can purchase them here. You will want to hurry as early bird discounted tickets are only available until September 1st, 2018.

PostgresConf Silicon Valley takes place on October 15th and 16th, 2018 at the Hilton San Jose. The schedule is not finalized. However, we have a comprehensive list of content from technical leaders in the Postgres ecosystem we are reviewing. Here is a brief list of some (but not all!) of the topics to be presented:

  • Postgres 11
  • Data integrity at scale
  • Distributed data and GPDR
  • Massively Parallel Postgres for Analytics
  • Data intersection between roles
  • RDS tips and tricks
  • I didn’t know Postgres could do that!
  • Performant time-series data management analytics
The Silicon Valley schedule is expected to be published this week and we are looking forward to seeing you all in October!

PostgresConf is organized by an all volunteer team of fantastic individuals and is backed by a 501c3 non-profit. The Silicon Valley conference provides the most cost effective avenue to learn all about Postgres and the Postgres ecosystem. We invite everyone to enjoy our expertly delivered presentations, good food, the hallway track and the opportunity to learn, network and appreciate everything that is Postgres.

Joshua D. Drake     August 21, 2018