Foraging or stealing: Can you pick your neighbour's overhanging fruit?

If your neighbours have a luscious mango tree, and its fruit overhangs your fence, does that mean you can pick it?