Joshua D. Drake Blog Posts




The presentation includes an introduction and setup for consul as the means of providing highly available PostgreSQL in local and geographically disparate data centers or cloud providers. The presentations includes:

*) Introduction to consul and its architecture
*) Setup of a single consul cluster
*) Setup for a few sample database instances (OLAP and OLTP)
*) Firewall requirements
*) Integration with bind, djbdns, and dnsmasq
*) Setup geographic failover to two different data centers and cloud providers
*) Various Best Practices tips and suggestions
*) Q&A

Joshua D. Drake     April 25, 2017

We caught up with Alex Tatiyants after finding out about his Pev project. This is an awesome web based visual explain analyzer that is similar to the awesome explain.depesz . 

Tell us a little bit (one or two paragraphs) about your project or how you use Postgres: 

I created Pev (Postgres EXPLAIN Visualizer) to scratch my own itch. EXPLAIN generates a wealth of information, but isn’t easy to make sense of. I wanted to create a tool that helps me quickly diagnose problems with queries. Apparently, other people found it useful as well.


Pev plan


Why did you chose Postgres for your project? 


Postgres is a fantastic database: performant, mature, feature rich, and of course open source. And in addition to being a first rate relational database, it has very strong document store features as well.


Have you attended a PgConf US event or do you plan to? 

I haven't had a chance to attend PgConf.

Are you interested in contributing to the community further and if so, in what fashion? 

I don’t have any concrete plans at the moment.

Any closing comments? 

Thank you for your interest.
Joshua D. Drake     August 16, 2017

Welcome to a new and bigger year for Postgres in 2018!

As our events have grown and evolved, so has our branding. We started as a small pgDay event, grown to a larger pgConf and now we are happy to announce that we matured into a full week long event called PostgresConf.

PostgresConf US 2018 is focused on People, Postgres and Data. People are the driving force behind the Postgres Ecosystem from the hackers writing the code, to the advocates telling the world about Postgres and to the administrators and developers using Postgres day to day. They will all be represented at PostgresConf.

 

Tickets

We have excellent news for you all: registration is open for PostgresConf US 2018 and discounted Early Bird tickets are just $399 -- $200 off the regular $599 -- and available through January 31, 2018, at https://postgresconf.org/conferences/2018

Please note that the early bird registration admits one person to the main conference sessions on Wednesday April 18 - Friday April 20, 2018, the Regulated Industry Summit, the Greenplum Summit, the Community Summit, and all evening activities from Wednesday - Friday. This registration does NOT include any training sessions on Monday April 16 or Tuesday April 17. Tickets for the training sessions are available separately, at $199 for half-day training and $499 for a full day training.

Day passes will be available for single day admission Wednesday through Friday, for $299 -- why not register early and get all 3 days for just $100 more?!


About our Conference

The Postgres Ecosystem is more than just the exceptional PostgreSQL database. It encompasses tools, solution, and services that enterprises demand for their mission-critical applications. PostgresConf brings the whole ecosystem under a single roof so enterprises can learn about all of the possible ways Postgres can be used in their environments.
 
This year, we are back in Jersey City from April 16th to April 20th at The Westin Jersey City Newport.  We also listened to our past attendees and expanded our training classes to 2 days so on April 16th and 17th, we are pleased to offer training sessions taught by professional trainers to bring additional depth to your learning experience. That will be followed by 3 days of great talks on April 18th - 20th. Additionally, we will host our 4th annual Regulated Industry Summit as well as the inaugural Greenplum Summit.

CFP

Want to present?  Our CFP is open!  Please visit https://postgresconf.org/conferences/2018 for Call for Papers information.  

Where to Stay

For those planning to attend, don’t forget to book your room early for the best rates. The Westin Jersey City Newport is the best place to stay and enjoy all conference activities. Attendees will surely mingle at the Westin bar and hallways throughout the afternoon and long into the evening. We have reserved a block of rooms at the special conference rate of $260/night plus applicable taxes for attendees who make their reservations via this dedicated Westin booking page. The hotel block will fill up quickly. The special rates will be available until March 26 or until the group block is sold out. 

 

Sponsors

Sponsorship opportunities for the conference are still available. If your business PostgreSQL based products or services or if you are looking to recruit a PostgreSQL expert at our job fair, this is the place to be. Don’t miss your chance to be part of this dynamic and growing ecosystem. Download the sponsorship prospectus at:
https://postgresconf.org/conferences/2018/sponsorships

Our current premium sponsors are:

Diamond: Amazon Web Services, Pivotal
Platinum: Compose, OpenSCG, 2ndQuadrant, Microsoft
Gold: Cybertec, JetBrains, Citus Data, EnterpriseDB

For more information, please visit https://postgresconf.org/conferences/2018

We look forward to seeing you in April!
 
Joshua D. Drake     December 19, 2017

Come as you are

The theme of Postgres Conference for 2020 is: Come as you are. We want everyone to feel welcome. You are welcome for your love of People, Postgres, Data and a desire to ascend beyond the box. It isn’t about your race, gender, sexuality, political affiliation, or love of blueberry flavored popcorn. It is 100% about you, the creativity and excellence that only you can bring to our community.

Postgres Conference 2020 CFP now open

We are actively seeking content for the largest Postgres Conference in the world, set to be held from March 23rd to 27th, 2020  at the Marriott Marquis, Time Square! Please submit your content here.

Postgres Conference Silicon Valley 2019

Postgres Conference Silicon Valley doubled its attendance, making it the largest Postgres  Conference on the West coast ever! We are very pleased to be able to bring so many community members together for education, fun, and ecosystem support!

 

Training

  • Postgres Conference is now offering live digital training throughout the year. Continuing on our mission of creating exceptional Postgres people, you can now not only register for pre-defined training but request specific training and we will connect you with a class! The current training options are:
    • PostgreSQL Performance and Maintenance
    • Finding and Fixing slow queries
    • Postgres + Kubernetes: yes it really is a match made in heaven
    • PostgreSQL Replication deployment and best practices
    • PgPool-II Performance and best practices

 

Register here: https://postgresconf.org/conferences/Postgres-Digital-Training-Series

 

Digital Events

We have free digital events coming up including topics such as Kubernetes, DistributedSQL, Backups, Postgis and many more. Coming up: 

Joshua D. Drake     October 02, 2019

Invisible Disease Awareness

“According to the Disabled World website, an estimated 10% of the U.S. population has what could be considered an ‘invisible’ disease, defined as a health condition that causes significant impairment and undermines the overall quality of life but does not outwardly manifest itself in ways that are apparent to others.” [1]



While normally our focus is Postgres, we wanted to take a moment to bring attention to the People side of People, Postgres, Data. May is mental health and Ehlers-Danlos awareness month. Ehlers-Danlos Syndrome (EDS) is a rare condition that affects the collagen throughout the entire body, resulting in dislocations, subluxations, lack of joint stability and support, tendinosis, and debilitating pain. There is no cure and the symptoms are life long.

 

In 2020, PostgresWarrior (AKA Amanda Nystrom) was diagnosed with Hypermobile EDS and Fibromyalgia. She is an instrumental and invaluable member of the People, Postgres, Data community. She has driven us forward in ways that so many of us never see and yet require to succeed. Many of our community are affected by invisible diseases - let's take a moment to appreciate what they accomplish and fight for in Postgres/Open Source.

Upcoming webinars | RSVP here

  • May 25, 1pm ET: Creating a Resilient PostgreSQL Cluster with Kubegres

  • June 15, 1pm ET: When it All Goes Wrong - Incident Response in Large Postgres Databases

  • June 23, 1pm ET: Making Postgres Fly on Kubernetes

  • June 29, 1pm ET: Implementing Cluster File Encryption in Postgres

24x7x365 Postgres & Linux servicesCommand Prompt, Inc.The last of the original Postgres companies

Sponsored

Community Chat

Our Discord Channel has 2000 community members waiting to participate in your Postgres success. Join us today with a community that has rule #1 of: Be Nice.

Podcasts








  1. https://www.socialworktoday.com/archive/072417p32.shtml
Joshua D. Drake     May 19, 2021     eds postgresql

PostgresConf Silicon Valley is being held October 15th-16th at the Hilton San Jose and the schedule is now available.


The two day event received over 80 submissions! A lot of the usual and legendary speakers are present but we were pleasantly surprised to find that so many new (to the conference) speakers submitted. It shows that the mission of People, Postgres, Data is growing at an amplified rate. The presentations are all of the "best-in-class quality" our attendees have come to expect from PostgresConf events.



Whether your needs are Big Data, Google Cloud, AWS RDS, GPDR Compliance, or you just have a burning desire to learn more about Kubernetes, PostgresConf Silicon Valley has you covered!

We also have two fantastic training opportunities which are the first of their kind:



Joshua D. Drake     September 04, 2018

The PostgresConf team wanted to provide some information on the performance of PostgresConf US 2018 and events over the past year, as well as potentially answer some pending questions. Ultimately our goals are about people, which is why our motto is, "People, Postgres, Data." With each event we hold, each talk we accept, and how we train our volunteers, we make sure people (the benefit for and to), postgres, and data are considered and included. If there is no benefit or consideration to the growth of people, it is not an option.


With that in mind, please read on to see how our focus on people, Postgres, and data had an impact on the community over the last year.

Since PostgresConf US 2017 we have had events in:
  • Philadelphia 
  • Ohio (in combination with Ohio Linux Fest) 
  • South Africa 
  • Seattle 
  • Austin 
  • Jersey City (PostgresConf US 2018) 
  • Nepal 
All of these events are non-profit and volunteer organized.





PostgresConf US 2018


Logistics


  • Days: 5, 2 for training, 3 for Breakout sessions and summits
  • Official Attendance #: 601
  • Content: Over 207 sessions submitted
  • Sessions: Over 108 sessions provided 


Partner Support (Sponsors): 28


We had a record level of support from partners this year and due to this support we are going to be forced to find a new venue for next year. Our Jersey city location no longer has the capacity to hold us. This will increase costs but initial indications are that our partners understand this and are willing to support us financially to help continue the success of our efforts and keep costs reasonable for attendees.


Diversity


This year we were able to work with Women Who Code NYC. They provided many volunteers and we provided them with the ability to experience some of the best Postgres based content available, at no charge. We expect great things from this budding relationship in the future.


Professional Growth


We held a Career and Talent Fair. A dozen companies were present to connect with potential employees.

We also held a surprisingly well attended speed mentoring session for potential employees (Especially helpful for many of the WWC) on resumes and interview practices.

Leadership


This year saw the continued elevation of our primary leadership: Viral Shah, Lloyd Albin, Amanda Nystrom, and Debra Cerda. They continued to increase their presence and responsibility within the conference and dedicated hundreds of hours voluntarily to the growth of people. Our international members have also increased their leadership roles with our on-the-ground teams in South Africa and China.


Summits



We had our standard Regulated Industry Summit but also a Greenplum Summit. As I am sure you are aware Greenplum is an Open Source, Postgres based MPP database. They were by far the most popular booth in the entire conference and their summit was very well attended. The relationship with Pivotal and the success of the Greenplum Summit allowed us to learn new ways to bring together the entire Postgres Ecosystem. We expect to run a minimum of 3 more summits at PostgresConf US 2019.



Contribution


We were able to have several excellent (and long) meetings with leaders of Pivotal, Microsoft, Google, and Amazon on how they can begin contributing more back to Postgresql.org. All of them expressed a deep drive to contribute and a desire to learn more about the core community. Of particular note is Google, who would like to contribute the following back to the community:

https://github.com/google/pg_page_verification

We discussed with them the process and various changes they would need to make (license and code style, etc.). We also educated them on the PostgreSQL.Org rigorous review process.

Microsoft is reviewing how they can contribute but they showed an interest in build farm nodes, professional technical writers to help with docs, and potentially code contribution to our Windows port.

International Collaboration

The Chinese Open Source Promotion Union launched the Chinese Postgres Association. We invited them to PostgresConf US and introduced them to the United States Community. We expect great things from the Chinese community in the future.

Future


As we continue to build up our on-the-ground teams, we will likely hold less events in the U.S. this year. We will instead be focused on a smaller number of events in the U.S. and adding events in China and Europe. We have had an amazing amount of support from the Chinese community and the current goal is 1000 attendees for that conference.

Our current plan of events for the U.S. are


  • San Jose (October 2018) 
  • Philadelphia 
  • PostgresConf US (Manhattan) 

Future International Events


  • October 2018. 
  • Spring of 2019. 
  • Spring of 2019. 

This may change as we are actively recruiting on-the-ground teams to help us grow the community.

Collaboration


Our goal is collaboration and growth with other PostgreSQL community and Ecosystem efforts. We want to allow each potential community member to find a home. A place that they feel positive about contributing to the community as a whole. As we continue to grow as a community, it is vital to recognize that each member has their own needs, desires, and return on investment requirement (professional or personal) that they are seeking.

Tidbits of note



On DBEngines PostgreSQL is the 4th most popular database but the significance is that of the other 3, we are the only ones that are growing in popularity. 
Joshua D. Drake     May 07, 2018

Tell us about your commitment and contribution to the Postgres Community

For over 10 years, EnterpriseDB (EDB) has been working with the community and enterprises to drive Postgres forward. EDB is one of the top PostgreSQL community contributors. Two of our team members are part of Postgres Core team, while 4 are committers, and 6 are named contributors. We invest heavily into Postgres performance, scalability, availability, migration, integration and support to make sure that enterprises can take advantage of Postgres' rapid innovation cycle and advanced capabilities.

 

What growth pattern do you expect for yourself as well as Postgres as a whole?

Postgres adoption is exploding and we can see that in our business results. Today, we support 92 of the Fortune 500 and 311 of the Forbes Global 2000. Our customers look to us for a reliable, high-performing, and cost-effective data management platform based on open source PostgreSQL.

 

Our customers are using EDB Postgres for mission critical applications. Their databases range all the way up to 50 TB with some handling over 50K transaction per second in environments that require 99.99%+ availability.

 

Our customers’ confidence in Postgres and EDB is no surprise. Postgres has been the #1 open source relational database in the DB-Engines.com rankings for two years in a row and EnterpriseDB has been chosen for the Gartner Magic Quadrant for Operational Database Management Systems for six years in a row.

 

 

How do you plan to assist Postgres in the future?

EDB continues to invest heavily in Postgres with key projects such as zHeap, Just-in-Time (JIT) compilation, and other efforts focused on performance and scalability.

 

What is the number one benefit you see within Postgres that everyone should be aware of?

EDB Postgres has become the general purpose database of choice for digital transformations, offering JSONB document support, GIS-support, EDB Postgres Oracle® compatibility features, key-value pair data, and increasing capabilities for analytical workloads. It has the fastest innovation cycle, the best deployment models, and the lowest cost of any commercial relational database.

 

What is the best thing about working with the Postgres community?

The best thing about working with the Postgres community is their fast innovation, resulting in extremely reliable code.

 

Tell us why you believe people should attend PostgresConf 2019 in March.

PostgreSQL is one of the oldest and most stable open source projects as a result of the commitment of its members and its independence as a stand-alone community. Over the years, Postgres has achieved parity with proprietary platforms in terms of performance and functionality. It has received a warm welcome from businesses looking to roll back database costs and ease vendor lock-in, and leading companies are adopting it with great success. This is just like it was with Linux 15 years ago. Enterprises understand that they have to adopt Postgres or they will be left behind.

 

Company Description
EnterpriseDB (EDB), the database platform company for digital business, delivers the premier open source-based data platform for new applications, cloud re-platforming, application modernization, and legacy migration. EDB Is the developer of the most complete Postgres-based database platform.

 

Joshua D. Drake     February 12, 2019

Where is your path leading you?

 

At Postgres Conference Silicon Valley I promised during the launch that after the conference was completed PostgresWarrior and I would be taking a freedom tour to various National Parks. 

 

For us, our path is serving the community through education and professional and personal development. This happens in many forms including these newsletters.

 

Recent projects have been coordinating a successful webinar series from Yugabyte, creating  online live Postgres instructor lead training, and launching a new educational series on PostGIS. This is all happening while the Call for Papers for Postgres Conference 2020 now open! The ongoing goal is to allow any person to receive the education they need to be successful with People, Postgres, Data year around.

Training

The current training options from Postgres Conference can be found here:

https://postgresconf.org/conferences/Postgres-Digital-Training-Series/schedule/events

We have two performance trainings coming up in October:

  • PostgreSQL Performance & Maintenance on October 29th
  • Finding and Fixing Slow Queries on October 30th

 

Both of these training opportunities sell out at the physical conferences. They are solid content and at a reasonable price (149.00 USD ) it is hard to say no to a few hours for education in your day!

Software

Are you frustrated with the limitations and fragility of Logical Replication in PostgreSQL Core? There is a new software on the block called pgcat and it has an impressive list of features to allow your Logical Replication experience to be exceptional.

 

Looking for a simple script to help find tuning opportunities for PostgreSQL? The perl script postgresqltuner may just be what you are looking for. Yes, there really is an active developer community for the Perl language still.

 

A HyperLogLog data type for PostgreSQL from our friends at Citus. This Postgres module introduces a new data type hll which is a HyperLogLog data structure. HyperLogLog is a fixed-size, set-like structure used for distinct value counting with tunable precision. For example, in 1280 bytes hll can estimate the count of tens of billions of distinct values with only a few percent error.

 

Our partner Heimdall Data has been creating a new type of connection pool that removes a significant limitation within other software such as PgBouncer and PgPool. If you are looking for Enterprise Authentication (Active Directory/LDAP) as well as intelligent pooling for many users (and connections), it may be worth a look. There is a webinar next week on how it all works!

Does your path allow people to “Come as you are?”

In consideration of all of the great news from our community we can’t help but reflect on the blessings we have in the world of Open Source. Remember that Open Source is about exceptionalism, creativity, and most importantly freedom. When communities start restricting these three tenets of Open Source, they are no longer Open Source communities, even if their software is.

 

The theme for Postgres Conference 2020 in NYC is “come as you are” and we are asserting this mantra throughout our entire community. Over the past few years there has been an influx of toxicity throughout all circles and it is time for civility and grace to return. It is time to remember that we are all human. We all have angels and demons to our personalities. We are all flawed and we are all exceptional in our own way.

 

"But just because I don't agree with someone on everything doesn't mean that I'm not going to be friends with them. When I say, 'be kind to one another,' I don't only mean the people that think the same way that you do. I mean be kind to everyone."

 

-- Ellen DeGeneres

 

(Yes, this happened. No, it wasn’t planned.) 

Just outside of Moab Utah.

 

Find YOUR path.



Joshua D. Drake     October 17, 2019


How do you use Postgres?

I work Fred Hutchinson Cancer Research Center and within Fred Hutch, I work for the largest group called SCHARP, Statistical Center for HIV/AIDS Research and Prevention. We use Postgres to monitor the AIDS drug trials real time to see if the trials are working or not. This means we collect the data from doctors and labs around the world, and analyzing the data. We also have servers where we receive data from other research institutes and share our randomized data, de-personalized, with other research institutes.


What community contributions have you provided?

In 2010 I started SeaPUG, Seattle Postgres Users Group, at the request of Josh Drake. I have at least have the presentations there every year. I have also discovered several PostgreSQL: bugs which have been fixed. Some of them affected every version of PostgreSQL. Bug numbers: 7553, 8173, 8257, 8291. I also found 8545, which has not been fixed but Core has acknowledge needs to be fixed but they are not sure where it should be fixed, pg_dump or pg_dumpall. I started the PostgreSQL track at LinuxFest Northwest in 2014 after my GIS presentation in 2013 was standing room only. This year I got a booth at the SeaGL, Seattle GNU Linux, conference with the idea of having a booth there next year along with also doing a PostgreSQL presentation next year at the conference.


You recently took a renewed interest in speaking at Postgres Conferences, why?

I have been giving presentations locally now for the last 7 years and so I am now ready to move on to the next step, doing presentations at the Local and National conferences around the United States.


What is the #1 barrier you see to Postgres adoption?

People not knowing about PostgreSQL, most people know about MYSQL, MSSQL and Oracle, but do not know about PostgreSQL. This is changing, some, with the Cloud providers now offering PostgreSQL, but I go to these conferences, LinuxFest Northwest and SeaGL, and people all the time are asking me, "What is Postgres and why should I use it over MYSQL, MSSQL or Oracle", because they have never heard of PostgreSQL.


What is something you feel the wider Postgres community could be better at?

We need to promote PostgreSQL so that new people starting personal projects and starting at companies, will think about PostgreSQL before other databases. This starts with getting the younger generation interested in PostgreSQL and that also means that we need to get the college professors willing to talk about PostgreSQL in their curriculums instead of ignoring PostgreSQL for all the other competing databases. Some of this means that at all the other conferences, we need to have a PostgreSQL presence, aka booth and presentations. We should also come up with a certification method for PostgreSQL DBA's, User's, Engineer's, etc so that prospective employers will have an idea of the prospective employees skill set.

Joshua D. Drake     December 12, 2017