Place the diced potatoes in a large pot and cover with water. Bring to a boil and cook until tender, about 15-20 minutes. Drain and let cool.

In a mixing bowl, whisk together the mayonnaise, Dijon mustard, apple cider vinegar, salt, pepper, and fresh dill until well combined.

In a large bowl, combine the cooled potatoes, celery, red onion, and sweet pickles. Pour the dressing over the potato mixture and gently stir to combine.

Cover the potato salad and refrigerate for at least 1 hour before serving to allow the flavors to meld.